&&&& RUNNING TensorRT.trtexec [TensorRT v8503] # trtexec --onnx=ptq-sparse-640.onnx --saveEngine=ptq-tiny-yolov7-sparse-640.trt --int8 --fp16 --sparsity=force --useCudaGraph --verbose [04/18/2023-18:31:17] [I] === Model Options === [04/18/2023-18:31:17] [I] Format: ONNX [04/18/2023-18:31:17] [I] Model: ptq-sparse-640.onnx [04/18/2023-18:31:17] [I] Output: [04/18/2023-18:31:17] [I] === Build Options === [04/18/2023-18:31:17] [I] Max batch: explicit batch [04/18/2023-18:31:17] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default [04/18/2023-18:31:17] [I] minTiming: 1 [04/18/2023-18:31:17] [I] avgTiming: 8 [04/18/2023-18:31:17] [I] Precision: FP32+FP16+INT8 [04/18/2023-18:31:17] [I] LayerPrecisions: [04/18/2023-18:31:17] [I] Calibration: Dynamic [04/18/2023-18:31:17] [I] Refit: Disabled [04/18/2023-18:31:17] [I] Sparsity: Forced [04/18/2023-18:31:17] [I] Safe mode: Disabled [04/18/2023-18:31:17] [I] DirectIO mode: Disabled [04/18/2023-18:31:17] [I] Restricted mode: Disabled [04/18/2023-18:31:17] [I] Build only: Disabled [04/18/2023-18:31:17] [I] Save engine: ptq-tiny-yolov7-sparse-640.trt [04/18/2023-18:31:17] [I] Load engine: [04/18/2023-18:31:17] [I] Profiling verbosity: 0 [04/18/2023-18:31:17] [I] Tactic sources: Using default tactic sources [04/18/2023-18:31:17] [I] timingCacheMode: local [04/18/2023-18:31:17] [I] timingCacheFile: [04/18/2023-18:31:17] [I] Heuristic: Disabled [04/18/2023-18:31:17] [I] Preview Features: Use default preview flags. [04/18/2023-18:31:17] [I] Input(s)s format: fp32:CHW [04/18/2023-18:31:17] [I] Output(s)s format: fp32:CHW [04/18/2023-18:31:17] [I] Input build shapes: model [04/18/2023-18:31:17] [I] Input calibration shapes: model [04/18/2023-18:31:17] [I] === System Options === [04/18/2023-18:31:17] [I] Device: 0 [04/18/2023-18:31:17] [I] DLACore: [04/18/2023-18:31:17] [I] Plugins: [04/18/2023-18:31:17] [I] === Inference Options === [04/18/2023-18:31:17] [I] Batch: Explicit [04/18/2023-18:31:17] [I] Input inference shapes: model [04/18/2023-18:31:17] [I] Iterations: 10 [04/18/2023-18:31:17] [I] Duration: 3s (+ 200ms warm up) [04/18/2023-18:31:17] [I] Sleep time: 0ms [04/18/2023-18:31:17] [I] Idle time: 0ms [04/18/2023-18:31:17] [I] Streams: 1 [04/18/2023-18:31:17] [I] ExposeDMA: Disabled [04/18/2023-18:31:17] [I] Data transfers: Enabled [04/18/2023-18:31:17] [I] Spin-wait: Disabled [04/18/2023-18:31:17] [I] Multithreading: Disabled [04/18/2023-18:31:17] [I] CUDA Graph: Enabled [04/18/2023-18:31:17] [I] Separate profiling: Disabled [04/18/2023-18:31:17] [I] Time Deserialize: Disabled [04/18/2023-18:31:17] [I] Time Refit: Disabled [04/18/2023-18:31:17] [I] NVTX verbosity: 0 [04/18/2023-18:31:17] [I] Persistent Cache Ratio: 0 [04/18/2023-18:31:17] [I] Inputs: [04/18/2023-18:31:17] [I] === Reporting Options === [04/18/2023-18:31:17] [I] Verbose: Enabled [04/18/2023-18:31:17] [I] Averages: 10 inferences [04/18/2023-18:31:17] [I] Percentiles: 90,95,99 [04/18/2023-18:31:17] [I] Dump refittable layers:Disabled [04/18/2023-18:31:17] [I] Dump output: Disabled [04/18/2023-18:31:17] [I] Profile: Disabled [04/18/2023-18:31:17] [I] Export timing to JSON file: [04/18/2023-18:31:17] [I] Export output to JSON file: [04/18/2023-18:31:17] [I] Export profile to JSON file: [04/18/2023-18:31:17] [I] [04/18/2023-18:31:17] [I] === Device Information === [04/18/2023-18:31:17] [I] Selected Device: NVIDIA RTX A5000 [04/18/2023-18:31:17] [I] Compute Capability: 8.6 [04/18/2023-18:31:17] [I] SMs: 64 [04/18/2023-18:31:17] [I] Compute Clock Rate: 1.695 GHz [04/18/2023-18:31:17] [I] Device Global Memory: 24253 MiB [04/18/2023-18:31:17] [I] Shared Memory per SM: 100 KiB [04/18/2023-18:31:17] [I] Memory Bus Width: 384 bits (ECC disabled) [04/18/2023-18:31:17] [I] Memory Clock Rate: 8.001 GHz [04/18/2023-18:31:17] [I] [04/18/2023-18:31:17] [I] TensorRT version: 8.5.3 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::BatchTilePlugin_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::CoordConvAC version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::CropAndResizeDynamic version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::CropAndResize version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::DecodeBbox3DPlugin version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::EfficientNMS_Explicit_TF_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::EfficientNMS_Implicit_TF_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::EfficientNMS_ONNX_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::EfficientNMS_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::fMHA_V2 version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::fMHCA version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::GenerateDetection_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::GridAnchorRect_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::GroupNorm version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 2 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::LayerNorm version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::MultilevelCropAndResize_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::MultilevelProposeROI_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::MultiscaleDeformableAttnPlugin_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::NMSDynamic_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::PillarScatterPlugin version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::ProposalDynamic version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::Proposal version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::Region_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::ROIAlign_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::ScatterND version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::SeqLen2Spatial version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::SplitGeLU version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::Split version 1 [04/18/2023-18:31:17] [V] [TRT] Registered plugin creator - ::VoxelGeneratorPlugin version 1 [04/18/2023-18:31:17] [I] [TRT] [MemUsageChange] Init CUDA: CPU +10, GPU +0, now: CPU 23, GPU 1359 (MiB) [04/18/2023-18:31:17] [V] [TRT] Trying to load shared library libnvinfer_builder_resource.so.8.5.3 [04/18/2023-18:31:17] [V] [TRT] Loaded shared library libnvinfer_builder_resource.so.8.5.3 [04/18/2023-18:31:19] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +444, GPU +120, now: CPU 522, GPU 1479 (MiB) [04/18/2023-18:31:19] [V] [TRT] CUDA lazy loading is enabled. [04/18/2023-18:31:19] [I] Start parsing network model [04/18/2023-18:31:19] [I] [TRT] ---------------------------------------------------------------- [04/18/2023-18:31:19] [I] [TRT] Input filename: ptq-sparse-640.onnx [04/18/2023-18:31:19] [I] [TRT] ONNX IR version: 0.0.7 [04/18/2023-18:31:19] [I] [TRT] Opset version: 13 [04/18/2023-18:31:19] [I] [TRT] Producer name: pytorch [04/18/2023-18:31:19] [I] [TRT] Producer version: 2.0.0 [04/18/2023-18:31:19] [I] [TRT] Domain: [04/18/2023-18:31:19] [I] [TRT] Model version: 0 [04/18/2023-18:31:19] [I] [TRT] Doc string: [04/18/2023-18:31:19] [I] [TRT] ---------------------------------------------------------------- [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::BatchTilePlugin_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::CoordConvAC version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::CropAndResizeDynamic version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::DecodeBbox3DPlugin version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::EfficientNMS_Explicit_TF_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::EfficientNMS_Implicit_TF_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::EfficientNMS_ONNX_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::EfficientNMS_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::fMHA_V2 version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::fMHCA version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::GenerateDetection_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::GridAnchorRect_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::GroupNorm version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 2 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::LayerNorm version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::MultilevelCropAndResize_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::MultilevelProposeROI_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::MultiscaleDeformableAttnPlugin_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::NMSDynamic_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::PillarScatterPlugin version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::ProposalDynamic version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::Proposal version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::ROIAlign_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::ScatterND version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::SeqLen2Spatial version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::SplitGeLU version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::Split version 1 [04/18/2023-18:31:19] [V] [TRT] Plugin creator already registered - ::VoxelGeneratorPlugin version 1 [04/18/2023-18:31:19] [V] [TRT] Adding network input: images with dtype: float32, dimensions: (1, 3, 640, 640) [04/18/2023-18:31:19] [V] [TRT] Registering tensor: images for ONNX tensor: images [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.0.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.0.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.1.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.1.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.2.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.2.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.3.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.3.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.4.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.4.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.5.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.5.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.7.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.7.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.9.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.9.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.10.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.10.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.11.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.11.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.12.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.12.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.14.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.14.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.16.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.16.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.17.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.17.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.18.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.18.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.19.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.19.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.21.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.21.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.23.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.23.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.24.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.24.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.25.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.25.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.26.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.26.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.28.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.28.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.29.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.29.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.30.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.30.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.35.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.35.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.37.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.37.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.38.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.38.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.40.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.40.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.42.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.42.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.43.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.43.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.44.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.44.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.45.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.45.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.47.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.47.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.48.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.48.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.50.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.50.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.52.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.52.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.53.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.53.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.54.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.54.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.55.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.55.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.57.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.57.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.58.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.58.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.60.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.60.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.61.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.61.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.62.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.62.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.63.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.63.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.65.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.65.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.66.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.66.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.68.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.68.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.69.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.69.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.70.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.70.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.71.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.71.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.73.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.73.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.74.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.74.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.75.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.75.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.76.conv.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.76.conv.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.77.m.0.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.77.m.0.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.77.m.1.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.77.m.1.bias [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.77.m.2.weight [04/18/2023-18:31:19] [V] [TRT] Importing initializer: model.77.m.2.bias [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.0/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.0/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.0/conv/_input_quantizer/Constant [Constant] outputs: [/model.0/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.0/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.0/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.0/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.0/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.0/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: images [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.0/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.0/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.0/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [images -> (1, 3, 640, 640)[FLOAT]], [/model.0/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.0/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.0/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.0/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.0/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.0/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.0/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.0/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.0/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.0/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 3, 640, 640)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.0/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.0/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.0/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.0/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.0/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.0/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 3, 640, 640)[FLOAT]], [/model.0/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.0/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.0/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.0/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.0/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.0/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 3, 640, 640)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.0/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.0/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.0/conv/_weight_quantizer/Constant [Constant] outputs: [/model.0/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.0/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.0/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.0/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.0/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.0/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.0.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.0/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.0/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.0/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.0.conv.weight -> (32, 3, 3, 3)[FLOAT]], [/model.0/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.0/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.0.conv.weight for ONNX node: model.0.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.0/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.0/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.0/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.0/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.0/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.0/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.0/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.0/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 3, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.0/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.0/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.0/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.0/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.0/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.0/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 3, 3, 3)[FLOAT]], [/model.0/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.0/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.0/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.0/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.0/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.0/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 3, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.0/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.0/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.0/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.0.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.0/conv/Conv [Conv] inputs: [/model.0/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 3, 640, 640)[FLOAT]], [/model.0/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 3, 3, 3)[FLOAT]], [model.0.conv.bias -> (32)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.0/conv/Conv for ONNX node: /model.0/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.0/conv/Conv_output_0 for ONNX tensor: /model.0/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.0/conv/Conv [Conv] outputs: [/model.0/conv/Conv_output_0 -> (1, 32, 320, 320)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.0/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.0/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.0/act/LeakyRelu [LeakyRelu] inputs: [/model.0/conv/Conv_output_0 -> (1, 32, 320, 320)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.0/act/LeakyRelu for ONNX node: /model.0/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.0/act/LeakyRelu_output_0 for ONNX tensor: /model.0/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.0/act/LeakyRelu [LeakyRelu] outputs: [/model.0/act/LeakyRelu_output_0 -> (1, 32, 320, 320)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.1/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.1/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.1/conv/_input_quantizer/Constant [Constant] outputs: [/model.1/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.1/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.1/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.1/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.1/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.1/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.0/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.1/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.1/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.1/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.0/act/LeakyRelu_output_0 -> (1, 32, 320, 320)[FLOAT]], [/model.1/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.1/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.1/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.1/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.1/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.1/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.1/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.1/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.1/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.1/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 32, 320, 320)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.1/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.1/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.1/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.1/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.1/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.1/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 32, 320, 320)[FLOAT]], [/model.1/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.1/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.1/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.1/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.1/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.1/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 32, 320, 320)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.1/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.1/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.1/conv/_weight_quantizer/Constant [Constant] outputs: [/model.1/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.1/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.1/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.1/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.1/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.1/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.1.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.1/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.1/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.1/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.1.conv.weight -> (64, 32, 3, 3)[FLOAT]], [/model.1/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.1/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.1.conv.weight for ONNX node: model.1.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.1/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.1/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.1/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.1/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.1/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.1/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.1/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.1/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 32, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.1/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.1/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.1/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.1/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.1/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.1/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 32, 3, 3)[FLOAT]], [/model.1/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.1/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.1/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.1/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.1/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.1/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 32, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.1/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.1/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.1/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.1.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.1/conv/Conv [Conv] inputs: [/model.1/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 32, 320, 320)[FLOAT]], [/model.1/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 32, 3, 3)[FLOAT]], [model.1.conv.bias -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.1/conv/Conv for ONNX node: /model.1/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.1/conv/Conv_output_0 for ONNX tensor: /model.1/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.1/conv/Conv [Conv] outputs: [/model.1/conv/Conv_output_0 -> (1, 64, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.1/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.1/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.1/act/LeakyRelu [LeakyRelu] inputs: [/model.1/conv/Conv_output_0 -> (1, 64, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.1/act/LeakyRelu for ONNX node: /model.1/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.1/act/LeakyRelu_output_0 for ONNX tensor: /model.1/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.1/act/LeakyRelu [LeakyRelu] outputs: [/model.1/act/LeakyRelu_output_0 -> (1, 64, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.2/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.2/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.2/conv/_input_quantizer/Constant [Constant] outputs: [/model.2/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.2/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.2/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.2/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.2/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.2/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.1/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.2/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.2/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.2/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.1/act/LeakyRelu_output_0 -> (1, 64, 160, 160)[FLOAT]], [/model.2/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.2/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.2/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.2/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.2/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.2/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.2/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.2/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.2/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.2/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.2/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.2/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.2/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.2/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.2/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.2/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 160, 160)[FLOAT]], [/model.2/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.2/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.2/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.2/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.2/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.2/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.2/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.2/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.2/conv/_weight_quantizer/Constant [Constant] outputs: [/model.2/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.2/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.2/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.2/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.2/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.2/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.2.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.2/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.2/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.2/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.2.conv.weight -> (32, 64, 1, 1)[FLOAT]], [/model.2/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.2/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.2.conv.weight for ONNX node: model.2.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.2/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.2/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.2/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.2/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.2/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.2/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.2/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.2/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 64, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.2/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.2/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.2/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.2/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.2/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.2/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 64, 1, 1)[FLOAT]], [/model.2/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.2/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.2/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.2/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.2/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.2/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 64, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.2/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.2/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.2/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.2.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.2/conv/Conv [Conv] inputs: [/model.2/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 160, 160)[FLOAT]], [/model.2/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 64, 1, 1)[FLOAT]], [model.2.conv.bias -> (32)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.2/conv/Conv for ONNX node: /model.2/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.2/conv/Conv_output_0 for ONNX tensor: /model.2/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.2/conv/Conv [Conv] outputs: [/model.2/conv/Conv_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.2/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.2/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.2/act/LeakyRelu [LeakyRelu] inputs: [/model.2/conv/Conv_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.2/act/LeakyRelu for ONNX node: /model.2/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.2/act/LeakyRelu_output_0 for ONNX tensor: /model.2/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.2/act/LeakyRelu [LeakyRelu] outputs: [/model.2/act/LeakyRelu_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.3/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.3/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.3/conv/_input_quantizer/Constant [Constant] outputs: [/model.3/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.3/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.3/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.3/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.3/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.3/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.1/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.3/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.3/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.3/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.1/act/LeakyRelu_output_0 -> (1, 64, 160, 160)[FLOAT]], [/model.3/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.3/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.3/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.3/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.3/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.3/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.3/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.3/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.3/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.3/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.3/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.3/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.3/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.3/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.3/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.3/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 160, 160)[FLOAT]], [/model.3/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.3/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.3/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.3/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.3/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.3/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.3/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.3/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.3/conv/_weight_quantizer/Constant [Constant] outputs: [/model.3/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.3/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.3/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.3/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.3/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.3/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.3.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.3/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.3/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.3/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.3.conv.weight -> (32, 64, 1, 1)[FLOAT]], [/model.3/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.3/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.3.conv.weight for ONNX node: model.3.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.3/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.3/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.3/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.3/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.3/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.3/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.3/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.3/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 64, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.3/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.3/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.3/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.3/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.3/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.3/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 64, 1, 1)[FLOAT]], [/model.3/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.3/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.3/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.3/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.3/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.3/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 64, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.3/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.3/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.3/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.3.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.3/conv/Conv [Conv] inputs: [/model.3/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 160, 160)[FLOAT]], [/model.3/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 64, 1, 1)[FLOAT]], [model.3.conv.bias -> (32)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.3/conv/Conv for ONNX node: /model.3/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.3/conv/Conv_output_0 for ONNX tensor: /model.3/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.3/conv/Conv [Conv] outputs: [/model.3/conv/Conv_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.3/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.3/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.3/act/LeakyRelu [LeakyRelu] inputs: [/model.3/conv/Conv_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.3/act/LeakyRelu for ONNX node: /model.3/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.3/act/LeakyRelu_output_0 for ONNX tensor: /model.3/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.3/act/LeakyRelu [LeakyRelu] outputs: [/model.3/act/LeakyRelu_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.4/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.4/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.4/conv/_input_quantizer/Constant [Constant] outputs: [/model.4/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.4/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.4/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.4/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.4/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.4/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.3/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.4/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.4/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.4/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.3/act/LeakyRelu_output_0 -> (1, 32, 160, 160)[FLOAT]], [/model.4/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.4/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.4/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.4/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.4/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.4/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.4/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.4/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.4/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.4/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.4/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.4/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.4/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.4/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.4/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.4/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 32, 160, 160)[FLOAT]], [/model.4/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.4/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.4/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.4/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.4/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.4/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.4/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.4/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.4/conv/_weight_quantizer/Constant [Constant] outputs: [/model.4/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.4/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.4/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.4/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.4/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.4/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.4.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.4/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.4/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.4/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.4.conv.weight -> (32, 32, 3, 3)[FLOAT]], [/model.4/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.4/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.4.conv.weight for ONNX node: model.4.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.4/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.4/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.4/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.4/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.4/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.4/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.4/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.4/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.4/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.4/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.4/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.4/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.4/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.4/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [/model.4/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.4/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.4/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.4/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.4/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.4/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.4/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.4/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.4/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.4.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.4/conv/Conv [Conv] inputs: [/model.4/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 32, 160, 160)[FLOAT]], [/model.4/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [model.4.conv.bias -> (32)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.4/conv/Conv for ONNX node: /model.4/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.4/conv/Conv_output_0 for ONNX tensor: /model.4/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.4/conv/Conv [Conv] outputs: [/model.4/conv/Conv_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.4/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.4/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.4/act/LeakyRelu [LeakyRelu] inputs: [/model.4/conv/Conv_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.4/act/LeakyRelu for ONNX node: /model.4/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.4/act/LeakyRelu_output_0 for ONNX tensor: /model.4/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.4/act/LeakyRelu [LeakyRelu] outputs: [/model.4/act/LeakyRelu_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.5/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.5/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.5/conv/_input_quantizer/Constant [Constant] outputs: [/model.5/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.5/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.5/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.5/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.5/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.5/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.4/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.5/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.5/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.5/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.4/act/LeakyRelu_output_0 -> (1, 32, 160, 160)[FLOAT]], [/model.5/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.5/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.5/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.5/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.5/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.5/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.5/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.5/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.5/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.5/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.5/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.5/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.5/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.5/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.5/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.5/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 32, 160, 160)[FLOAT]], [/model.5/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.5/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.5/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.5/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.5/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.5/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.5/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.5/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.5/conv/_weight_quantizer/Constant [Constant] outputs: [/model.5/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.5/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.5/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.5/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.5/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.5/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.5.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.5/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.5/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.5/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.5.conv.weight -> (32, 32, 3, 3)[FLOAT]], [/model.5/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.5/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.5.conv.weight for ONNX node: model.5.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.5/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.5/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.5/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.5/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.5/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.5/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.5/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.5/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.5/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.5/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.5/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.5/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.5/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.5/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [/model.5/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.5/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.5/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.5/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.5/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.5/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.5/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.5/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.5/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.5.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.5/conv/Conv [Conv] inputs: [/model.5/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 32, 160, 160)[FLOAT]], [/model.5/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [model.5.conv.bias -> (32)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.5/conv/Conv for ONNX node: /model.5/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.5/conv/Conv_output_0 for ONNX tensor: /model.5/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.5/conv/Conv [Conv] outputs: [/model.5/conv/Conv_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.5/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.5/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.5/act/LeakyRelu [LeakyRelu] inputs: [/model.5/conv/Conv_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.5/act/LeakyRelu for ONNX node: /model.5/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.5/act/LeakyRelu_output_0 for ONNX tensor: /model.5/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.5/act/LeakyRelu [LeakyRelu] outputs: [/model.5/act/LeakyRelu_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.6/Concat [Concat] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.5/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.4/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.3/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.2/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.6/Concat [Concat] inputs: [/model.5/act/LeakyRelu_output_0 -> (1, 32, 160, 160)[FLOAT]], [/model.4/act/LeakyRelu_output_0 -> (1, 32, 160, 160)[FLOAT]], [/model.3/act/LeakyRelu_output_0 -> (1, 32, 160, 160)[FLOAT]], [/model.2/act/LeakyRelu_output_0 -> (1, 32, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.6/Concat for ONNX node: /model.6/Concat [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.6/Concat_output_0 for ONNX tensor: /model.6/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.6/Concat [Concat] outputs: [/model.6/Concat_output_0 -> (1, 128, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.7/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.7/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.7/conv/_input_quantizer/Constant [Constant] outputs: [/model.7/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.7/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.7/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.7/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.7/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.7/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.6/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.7/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.7/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.7/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.6/Concat_output_0 -> (1, 128, 160, 160)[FLOAT]], [/model.7/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.7/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.7/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.7/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.7/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.7/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.7/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.7/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.7/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.7/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.7/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.7/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.7/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.7/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.7/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.7/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 160, 160)[FLOAT]], [/model.7/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.7/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.7/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.7/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.7/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.7/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.7/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.7/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.7/conv/_weight_quantizer/Constant [Constant] outputs: [/model.7/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.7/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.7/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.7/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.7/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.7/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.7.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.7/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.7/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.7/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.7.conv.weight -> (64, 128, 1, 1)[FLOAT]], [/model.7/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.7/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.7.conv.weight for ONNX node: model.7.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.7/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.7/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.7/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.7/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.7/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.7/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.7/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.7/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.7/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.7/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.7/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.7/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.7/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.7/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [/model.7/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.7/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.7/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.7/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.7/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.7/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.7/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.7/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.7/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.7.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.7/conv/Conv [Conv] inputs: [/model.7/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 160, 160)[FLOAT]], [/model.7/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [model.7.conv.bias -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.7/conv/Conv for ONNX node: /model.7/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.7/conv/Conv_output_0 for ONNX tensor: /model.7/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.7/conv/Conv [Conv] outputs: [/model.7/conv/Conv_output_0 -> (1, 64, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.7/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.7/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.7/act/LeakyRelu [LeakyRelu] inputs: [/model.7/conv/Conv_output_0 -> (1, 64, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.7/act/LeakyRelu for ONNX node: /model.7/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.7/act/LeakyRelu_output_0 for ONNX tensor: /model.7/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.7/act/LeakyRelu [LeakyRelu] outputs: [/model.7/act/LeakyRelu_output_0 -> (1, 64, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.8/m/MaxPool [MaxPool] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.7/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.8/m/MaxPool [MaxPool] inputs: [/model.7/act/LeakyRelu_output_0 -> (1, 64, 160, 160)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.8/m/MaxPool for ONNX node: /model.8/m/MaxPool [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.8/m/MaxPool_output_0 for ONNX tensor: /model.8/m/MaxPool_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.8/m/MaxPool [MaxPool] outputs: [/model.8/m/MaxPool_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.9/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.9/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.9/conv/_input_quantizer/Constant [Constant] outputs: [/model.9/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.9/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.9/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.9/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.9/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.9/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.8/m/MaxPool_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.9/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.9/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.9/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.8/m/MaxPool_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.9/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.9/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.9/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.9/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.9/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.9/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.9/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.9/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.9/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.9/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.9/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.9/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.9/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.9/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.9/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.9/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.9/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.9/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.9/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.9/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.9/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.9/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.9/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.9/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.9/conv/_weight_quantizer/Constant [Constant] outputs: [/model.9/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.9/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.9/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.9/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.9/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.9/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.9.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.9/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.9/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.9/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.9.conv.weight -> (64, 64, 1, 1)[FLOAT]], [/model.9/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.9/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.9.conv.weight for ONNX node: model.9.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.9/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.9/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.9/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.9/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.9/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.9/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.9/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.9/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.9/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.9/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.9/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.9/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.9/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.9/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 1, 1)[FLOAT]], [/model.9/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.9/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.9/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.9/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.9/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.9/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.9/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.9/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.9/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.9.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.9/conv/Conv [Conv] inputs: [/model.9/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.9/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 1, 1)[FLOAT]], [model.9.conv.bias -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.9/conv/Conv for ONNX node: /model.9/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.9/conv/Conv_output_0 for ONNX tensor: /model.9/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.9/conv/Conv [Conv] outputs: [/model.9/conv/Conv_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.9/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.9/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.9/act/LeakyRelu [LeakyRelu] inputs: [/model.9/conv/Conv_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.9/act/LeakyRelu for ONNX node: /model.9/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.9/act/LeakyRelu_output_0 for ONNX tensor: /model.9/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.9/act/LeakyRelu [LeakyRelu] outputs: [/model.9/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.10/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.10/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.10/conv/_weight_quantizer/Constant [Constant] outputs: [/model.10/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.10/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.10/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.10/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.10/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.10/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.10.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.10/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.10/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.10/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.10.conv.weight -> (64, 64, 1, 1)[FLOAT]], [/model.10/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.10/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.10.conv.weight for ONNX node: model.10.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.10/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.10/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.10/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.10/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.10/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.10/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.10/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.10/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.10/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.10/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.10/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.10/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.10/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.10/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 1, 1)[FLOAT]], [/model.10/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.10/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.10/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.10/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.10/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.10/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.10/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.9/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.10/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.10.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.10/conv/Conv [Conv] inputs: [/model.9/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.10/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 1, 1)[FLOAT]], [model.10.conv.bias -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.10/conv/Conv for ONNX node: /model.10/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.10/conv/Conv_output_0 for ONNX tensor: /model.10/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.10/conv/Conv [Conv] outputs: [/model.10/conv/Conv_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.10/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.10/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.10/act/LeakyRelu [LeakyRelu] inputs: [/model.10/conv/Conv_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.10/act/LeakyRelu for ONNX node: /model.10/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.10/act/LeakyRelu_output_0 for ONNX tensor: /model.10/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.10/act/LeakyRelu [LeakyRelu] outputs: [/model.10/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.11/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.11/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.11/conv/_input_quantizer/Constant [Constant] outputs: [/model.11/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.11/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.11/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.11/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.11/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.11/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.10/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.11/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.11/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.11/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.10/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.11/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.11/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.11/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.11/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.11/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.11/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.11/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.11/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.11/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.11/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.11/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.11/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.11/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.11/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.11/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.11/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.11/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.11/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.11/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.11/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.11/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.11/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.11/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.11/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.11/conv/_weight_quantizer/Constant [Constant] outputs: [/model.11/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.11/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.11/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.11/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.11/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.11/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.11.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.11/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.11/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.11/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.11.conv.weight -> (64, 64, 3, 3)[FLOAT]], [/model.11/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.11/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.11.conv.weight for ONNX node: model.11.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.11/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.11/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.11/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.11/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.11/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.11/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.11/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.11/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.11/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.11/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.11/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.11/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.11/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.11/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [/model.11/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.11/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.11/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.11/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.11/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.11/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.11/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.11/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.11/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.11.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.11/conv/Conv [Conv] inputs: [/model.11/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.11/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [model.11.conv.bias -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.11/conv/Conv for ONNX node: /model.11/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.11/conv/Conv_output_0 for ONNX tensor: /model.11/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.11/conv/Conv [Conv] outputs: [/model.11/conv/Conv_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.11/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.11/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.11/act/LeakyRelu [LeakyRelu] inputs: [/model.11/conv/Conv_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.11/act/LeakyRelu for ONNX node: /model.11/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.11/act/LeakyRelu_output_0 for ONNX tensor: /model.11/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.11/act/LeakyRelu [LeakyRelu] outputs: [/model.11/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.12/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.12/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.12/conv/_input_quantizer/Constant [Constant] outputs: [/model.12/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.12/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.12/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.12/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.12/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.12/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.11/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.12/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.12/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.12/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.11/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.12/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.12/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.12/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.12/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.12/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.12/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.12/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.12/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.12/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.12/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.12/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.12/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.12/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.12/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.12/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.12/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.12/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.12/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.12/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.12/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.12/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.12/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.12/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.12/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.12/conv/_weight_quantizer/Constant [Constant] outputs: [/model.12/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.12/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.12/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.12/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.12/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.12/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.12.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.12/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.12/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.12/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.12.conv.weight -> (64, 64, 3, 3)[FLOAT]], [/model.12/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.12/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.12.conv.weight for ONNX node: model.12.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.12/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.12/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.12/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.12/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.12/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.12/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.12/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.12/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.12/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.12/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.12/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.12/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.12/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.12/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [/model.12/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.12/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.12/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.12/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.12/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.12/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.12/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.12/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.12/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.12.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.12/conv/Conv [Conv] inputs: [/model.12/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.12/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [model.12.conv.bias -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.12/conv/Conv for ONNX node: /model.12/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.12/conv/Conv_output_0 for ONNX tensor: /model.12/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.12/conv/Conv [Conv] outputs: [/model.12/conv/Conv_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.12/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.12/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.12/act/LeakyRelu [LeakyRelu] inputs: [/model.12/conv/Conv_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.12/act/LeakyRelu for ONNX node: /model.12/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.12/act/LeakyRelu_output_0 for ONNX tensor: /model.12/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.12/act/LeakyRelu [LeakyRelu] outputs: [/model.12/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.13/Concat [Concat] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.12/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.11/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.10/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.9/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.13/Concat [Concat] inputs: [/model.12/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.11/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.10/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.9/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.13/Concat for ONNX node: /model.13/Concat [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.13/Concat_output_0 for ONNX tensor: /model.13/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.13/Concat [Concat] outputs: [/model.13/Concat_output_0 -> (1, 256, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.14/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.14/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.14/conv/_input_quantizer/Constant [Constant] outputs: [/model.14/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.14/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.14/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.14/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.14/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.14/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.13/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.14/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.14/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.14/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.13/Concat_output_0 -> (1, 256, 80, 80)[FLOAT]], [/model.14/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.14/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.14/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.14/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.14/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.14/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.14/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.14/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.14/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.14/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.14/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.14/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.14/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.14/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.14/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.14/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 80, 80)[FLOAT]], [/model.14/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.14/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.14/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.14/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.14/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.14/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.14/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.14/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.14/conv/_weight_quantizer/Constant [Constant] outputs: [/model.14/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.14/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.14/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.14/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.14/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.14/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.14.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.14/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.14/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.14/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.14.conv.weight -> (128, 256, 1, 1)[FLOAT]], [/model.14/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.14/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.14.conv.weight for ONNX node: model.14.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.14/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.14/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.14/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.14/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.14/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.14/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.14/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.14/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.14/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.14/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.14/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.14/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.14/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.14/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [/model.14/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.14/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.14/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.14/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.14/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.14/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.14/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.14/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.14/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.14.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.14/conv/Conv [Conv] inputs: [/model.14/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 80, 80)[FLOAT]], [/model.14/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [model.14.conv.bias -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.14/conv/Conv for ONNX node: /model.14/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.14/conv/Conv_output_0 for ONNX tensor: /model.14/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.14/conv/Conv [Conv] outputs: [/model.14/conv/Conv_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.14/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.14/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.14/act/LeakyRelu [LeakyRelu] inputs: [/model.14/conv/Conv_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.14/act/LeakyRelu for ONNX node: /model.14/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.14/act/LeakyRelu_output_0 for ONNX tensor: /model.14/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.14/act/LeakyRelu [LeakyRelu] outputs: [/model.14/act/LeakyRelu_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.15/m/MaxPool [MaxPool] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.14/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.15/m/MaxPool [MaxPool] inputs: [/model.14/act/LeakyRelu_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.15/m/MaxPool for ONNX node: /model.15/m/MaxPool [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.15/m/MaxPool_output_0 for ONNX tensor: /model.15/m/MaxPool_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.15/m/MaxPool [MaxPool] outputs: [/model.15/m/MaxPool_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.16/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.16/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.16/conv/_input_quantizer/Constant [Constant] outputs: [/model.16/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.16/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.16/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.16/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.16/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.16/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.15/m/MaxPool_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.16/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.16/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.16/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.15/m/MaxPool_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.16/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.16/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.16/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.16/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.16/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.16/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.16/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.16/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.16/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.16/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.16/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.16/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.16/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.16/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.16/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.16/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.16/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.16/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.16/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.16/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.16/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.16/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.16/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.16/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.16/conv/_weight_quantizer/Constant [Constant] outputs: [/model.16/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.16/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.16/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.16/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.16/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.16/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.16.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.16/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.16/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.16/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.16.conv.weight -> (128, 128, 1, 1)[FLOAT]], [/model.16/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.16/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.16.conv.weight for ONNX node: model.16.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.16/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.16/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.16/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.16/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.16/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.16/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.16/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.16/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 128, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.16/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.16/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.16/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.16/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.16/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.16/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 128, 1, 1)[FLOAT]], [/model.16/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.16/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.16/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.16/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.16/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.16/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 128, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.16/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.16/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.16/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.16.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.16/conv/Conv [Conv] inputs: [/model.16/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.16/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 128, 1, 1)[FLOAT]], [model.16.conv.bias -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.16/conv/Conv for ONNX node: /model.16/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.16/conv/Conv_output_0 for ONNX tensor: /model.16/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.16/conv/Conv [Conv] outputs: [/model.16/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.16/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.16/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.16/act/LeakyRelu [LeakyRelu] inputs: [/model.16/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.16/act/LeakyRelu for ONNX node: /model.16/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.16/act/LeakyRelu_output_0 for ONNX tensor: /model.16/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.16/act/LeakyRelu [LeakyRelu] outputs: [/model.16/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.17/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.17/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.17/conv/_input_quantizer/Constant [Constant] outputs: [/model.17/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.17/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.17/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.17/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.17/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.17/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.15/m/MaxPool_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.17/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.17/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.17/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.15/m/MaxPool_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.17/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.17/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.17/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.17/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.17/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.17/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.17/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.17/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.17/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.17/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.17/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.17/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.17/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.17/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.17/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.17/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.17/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.17/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.17/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.17/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.17/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.17/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.17/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.17/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.17/conv/_weight_quantizer/Constant [Constant] outputs: [/model.17/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.17/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.17/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.17/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.17/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.17/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.17.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.17/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.17/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.17/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.17.conv.weight -> (128, 128, 1, 1)[FLOAT]], [/model.17/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.17/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.17.conv.weight for ONNX node: model.17.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.17/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.17/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.17/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.17/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.17/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.17/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.17/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.17/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 128, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.17/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.17/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.17/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.17/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.17/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.17/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 128, 1, 1)[FLOAT]], [/model.17/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.17/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.17/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.17/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.17/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.17/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 128, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.17/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.17/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.17/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.17.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.17/conv/Conv [Conv] inputs: [/model.17/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.17/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 128, 1, 1)[FLOAT]], [model.17.conv.bias -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.17/conv/Conv for ONNX node: /model.17/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.17/conv/Conv_output_0 for ONNX tensor: /model.17/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.17/conv/Conv [Conv] outputs: [/model.17/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.17/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.17/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.17/act/LeakyRelu [LeakyRelu] inputs: [/model.17/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.17/act/LeakyRelu for ONNX node: /model.17/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.17/act/LeakyRelu_output_0 for ONNX tensor: /model.17/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.17/act/LeakyRelu [LeakyRelu] outputs: [/model.17/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.18/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.18/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.18/conv/_input_quantizer/Constant [Constant] outputs: [/model.18/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.18/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.18/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.18/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.18/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.18/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.17/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.18/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.18/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.18/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.17/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.18/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.18/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.18/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.18/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.18/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.18/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.18/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.18/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.18/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.18/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.18/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.18/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.18/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.18/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.18/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.18/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.18/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.18/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.18/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.18/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.18/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.18/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.18/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.18/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.18/conv/_weight_quantizer/Constant [Constant] outputs: [/model.18/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.18/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.18/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.18/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.18/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.18/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.18.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.18/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.18/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.18/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.18.conv.weight -> (128, 128, 3, 3)[FLOAT]], [/model.18/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.18/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.18.conv.weight for ONNX node: model.18.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.18/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.18/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.18/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.18/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.18/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.18/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.18/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.18/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.18/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.18/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.18/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.18/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.18/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.18/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [/model.18/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.18/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.18/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.18/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.18/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.18/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.18/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.18/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.18/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.18.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.18/conv/Conv [Conv] inputs: [/model.18/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.18/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [model.18.conv.bias -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.18/conv/Conv for ONNX node: /model.18/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.18/conv/Conv_output_0 for ONNX tensor: /model.18/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.18/conv/Conv [Conv] outputs: [/model.18/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.18/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.18/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.18/act/LeakyRelu [LeakyRelu] inputs: [/model.18/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.18/act/LeakyRelu for ONNX node: /model.18/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.18/act/LeakyRelu_output_0 for ONNX tensor: /model.18/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.18/act/LeakyRelu [LeakyRelu] outputs: [/model.18/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.19/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.19/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.19/conv/_input_quantizer/Constant [Constant] outputs: [/model.19/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.19/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.19/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.19/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.19/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.19/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.18/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.19/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.19/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.19/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.18/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.19/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.19/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.19/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.19/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.19/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.19/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.19/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.19/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.19/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.19/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.19/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.19/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.19/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.19/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.19/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.19/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.19/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.19/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.19/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.19/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.19/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.19/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.19/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.19/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.19/conv/_weight_quantizer/Constant [Constant] outputs: [/model.19/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.19/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.19/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.19/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.19/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.19/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.19.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.19/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.19/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.19/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.19.conv.weight -> (128, 128, 3, 3)[FLOAT]], [/model.19/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.19/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.19.conv.weight for ONNX node: model.19.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.19/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.19/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.19/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.19/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.19/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.19/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.19/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.19/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.19/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.19/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.19/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.19/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.19/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.19/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [/model.19/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.19/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.19/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.19/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.19/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.19/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.19/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.19/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.19/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.19.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.19/conv/Conv [Conv] inputs: [/model.19/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.19/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [model.19.conv.bias -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.19/conv/Conv for ONNX node: /model.19/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.19/conv/Conv_output_0 for ONNX tensor: /model.19/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.19/conv/Conv [Conv] outputs: [/model.19/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.19/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.19/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.19/act/LeakyRelu [LeakyRelu] inputs: [/model.19/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.19/act/LeakyRelu for ONNX node: /model.19/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.19/act/LeakyRelu_output_0 for ONNX tensor: /model.19/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.19/act/LeakyRelu [LeakyRelu] outputs: [/model.19/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.20/Concat [Concat] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.19/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.18/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.17/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.16/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.20/Concat [Concat] inputs: [/model.19/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.18/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.17/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.16/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.20/Concat for ONNX node: /model.20/Concat [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.20/Concat_output_0 for ONNX tensor: /model.20/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.20/Concat [Concat] outputs: [/model.20/Concat_output_0 -> (1, 512, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.21/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.21/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.21/conv/_input_quantizer/Constant [Constant] outputs: [/model.21/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.21/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.21/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.21/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.21/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.21/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.20/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.21/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.21/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.21/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.20/Concat_output_0 -> (1, 512, 40, 40)[FLOAT]], [/model.21/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.21/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.21/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.21/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.21/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.21/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.21/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.21/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.21/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.21/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.21/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.21/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.21/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.21/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.21/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.21/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 40, 40)[FLOAT]], [/model.21/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.21/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.21/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.21/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.21/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.21/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.21/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.21/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.21/conv/_weight_quantizer/Constant [Constant] outputs: [/model.21/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.21/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.21/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.21/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.21/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.21/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.21.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.21/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.21/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.21/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.21.conv.weight -> (256, 512, 1, 1)[FLOAT]], [/model.21/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.21/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.21.conv.weight for ONNX node: model.21.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.21/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.21/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.21/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.21/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.21/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.21/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.21/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.21/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.21/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.21/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.21/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.21/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.21/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.21/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [/model.21/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.21/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.21/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.21/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.21/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.21/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.21/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.21/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.21/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.21.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.21/conv/Conv [Conv] inputs: [/model.21/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 40, 40)[FLOAT]], [/model.21/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [model.21.conv.bias -> (256)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.21/conv/Conv for ONNX node: /model.21/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.21/conv/Conv_output_0 for ONNX tensor: /model.21/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.21/conv/Conv [Conv] outputs: [/model.21/conv/Conv_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.21/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.21/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.21/act/LeakyRelu [LeakyRelu] inputs: [/model.21/conv/Conv_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.21/act/LeakyRelu for ONNX node: /model.21/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.21/act/LeakyRelu_output_0 for ONNX tensor: /model.21/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.21/act/LeakyRelu [LeakyRelu] outputs: [/model.21/act/LeakyRelu_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.22/m/MaxPool [MaxPool] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.21/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.22/m/MaxPool [MaxPool] inputs: [/model.21/act/LeakyRelu_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.22/m/MaxPool for ONNX node: /model.22/m/MaxPool [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.22/m/MaxPool_output_0 for ONNX tensor: /model.22/m/MaxPool_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.22/m/MaxPool [MaxPool] outputs: [/model.22/m/MaxPool_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.23/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.23/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.23/conv/_input_quantizer/Constant [Constant] outputs: [/model.23/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.23/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.23/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.23/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.23/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.23/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.22/m/MaxPool_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.23/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.23/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.23/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.22/m/MaxPool_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.23/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.23/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.23/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.23/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.23/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.23/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.23/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.23/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.23/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.23/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.23/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.23/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.23/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.23/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.23/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.23/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.23/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.23/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.23/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.23/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.23/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.23/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.23/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.23/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.23/conv/_weight_quantizer/Constant [Constant] outputs: [/model.23/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.23/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.23/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.23/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.23/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.23/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.23.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.23/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.23/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.23/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.23.conv.weight -> (256, 256, 1, 1)[FLOAT]], [/model.23/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.23/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.23.conv.weight for ONNX node: model.23.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.23/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.23/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.23/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.23/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.23/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.23/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.23/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.23/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 256, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.23/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.23/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.23/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.23/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.23/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.23/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 256, 1, 1)[FLOAT]], [/model.23/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.23/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.23/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.23/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.23/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.23/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 256, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.23/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.23/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.23/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.23.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.23/conv/Conv [Conv] inputs: [/model.23/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.23/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 256, 1, 1)[FLOAT]], [model.23.conv.bias -> (256)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.23/conv/Conv for ONNX node: /model.23/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.23/conv/Conv_output_0 for ONNX tensor: /model.23/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.23/conv/Conv [Conv] outputs: [/model.23/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.23/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.23/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.23/act/LeakyRelu [LeakyRelu] inputs: [/model.23/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.23/act/LeakyRelu for ONNX node: /model.23/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.23/act/LeakyRelu_output_0 for ONNX tensor: /model.23/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.23/act/LeakyRelu [LeakyRelu] outputs: [/model.23/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.24/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.24/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.24/conv/_input_quantizer/Constant [Constant] outputs: [/model.24/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.24/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.24/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.24/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.24/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.24/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.22/m/MaxPool_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.24/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.24/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.24/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.22/m/MaxPool_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.24/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.24/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.24/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.24/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.24/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.24/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.24/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.24/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.24/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.24/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.24/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.24/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.24/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.24/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.24/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.24/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.24/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.24/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.24/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.24/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.24/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.24/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.24/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.24/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.24/conv/_weight_quantizer/Constant [Constant] outputs: [/model.24/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.24/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.24/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.24/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.24/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.24/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.24.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.24/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.24/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.24/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.24.conv.weight -> (256, 256, 1, 1)[FLOAT]], [/model.24/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.24/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.24.conv.weight for ONNX node: model.24.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.24/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.24/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.24/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.24/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.24/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.24/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.24/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.24/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 256, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.24/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.24/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.24/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.24/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.24/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.24/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 256, 1, 1)[FLOAT]], [/model.24/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.24/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.24/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.24/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.24/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.24/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 256, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.24/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.24/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.24/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.24.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.24/conv/Conv [Conv] inputs: [/model.24/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.24/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 256, 1, 1)[FLOAT]], [model.24.conv.bias -> (256)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.24/conv/Conv for ONNX node: /model.24/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.24/conv/Conv_output_0 for ONNX tensor: /model.24/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.24/conv/Conv [Conv] outputs: [/model.24/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.24/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.24/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.24/act/LeakyRelu [LeakyRelu] inputs: [/model.24/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.24/act/LeakyRelu for ONNX node: /model.24/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.24/act/LeakyRelu_output_0 for ONNX tensor: /model.24/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.24/act/LeakyRelu [LeakyRelu] outputs: [/model.24/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.25/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.25/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.25/conv/_input_quantizer/Constant [Constant] outputs: [/model.25/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.25/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.25/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.25/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.25/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.25/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.24/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.25/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.25/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.25/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.24/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.25/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.25/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.25/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.25/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.25/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.25/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.25/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.25/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.25/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.25/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.25/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.25/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.25/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.25/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.25/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.25/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.25/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.25/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.25/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.25/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.25/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.25/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.25/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.25/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.25/conv/_weight_quantizer/Constant [Constant] outputs: [/model.25/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.25/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.25/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.25/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.25/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.25/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.25.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.25/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.25/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.25/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.25.conv.weight -> (256, 256, 3, 3)[FLOAT]], [/model.25/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.25/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.25.conv.weight for ONNX node: model.25.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.25/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.25/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.25/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.25/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.25/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.25/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.25/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.25/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 256, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.25/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.25/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.25/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.25/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.25/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.25/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 256, 3, 3)[FLOAT]], [/model.25/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.25/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.25/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.25/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.25/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.25/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 256, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.25/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.25/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.25/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.25.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.25/conv/Conv [Conv] inputs: [/model.25/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.25/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 256, 3, 3)[FLOAT]], [model.25.conv.bias -> (256)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.25/conv/Conv for ONNX node: /model.25/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.25/conv/Conv_output_0 for ONNX tensor: /model.25/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.25/conv/Conv [Conv] outputs: [/model.25/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.25/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.25/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.25/act/LeakyRelu [LeakyRelu] inputs: [/model.25/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.25/act/LeakyRelu for ONNX node: /model.25/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.25/act/LeakyRelu_output_0 for ONNX tensor: /model.25/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.25/act/LeakyRelu [LeakyRelu] outputs: [/model.25/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.26/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.26/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.26/conv/_input_quantizer/Constant [Constant] outputs: [/model.26/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.26/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.26/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.26/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.26/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.26/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.25/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.26/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.26/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.26/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.25/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.26/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.26/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.26/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.26/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.26/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.26/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.26/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.26/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.26/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.26/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.26/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.26/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.26/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.26/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.26/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.26/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.26/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.26/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.26/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.26/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.26/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.26/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.26/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.26/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.26/conv/_weight_quantizer/Constant [Constant] outputs: [/model.26/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.26/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.26/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.26/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.26/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.26/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.26.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.26/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.26/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.26/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.26.conv.weight -> (256, 256, 3, 3)[FLOAT]], [/model.26/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.26/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.26.conv.weight for ONNX node: model.26.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.26/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.26/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.26/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.26/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.26/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.26/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.26/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.26/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 256, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.26/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.26/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.26/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.26/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.26/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.26/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 256, 3, 3)[FLOAT]], [/model.26/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.26/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.26/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.26/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.26/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.26/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 256, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.26/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.26/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.26/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.26.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.26/conv/Conv [Conv] inputs: [/model.26/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.26/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 256, 3, 3)[FLOAT]], [model.26.conv.bias -> (256)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.26/conv/Conv for ONNX node: /model.26/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.26/conv/Conv_output_0 for ONNX tensor: /model.26/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.26/conv/Conv [Conv] outputs: [/model.26/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.26/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.26/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.26/act/LeakyRelu [LeakyRelu] inputs: [/model.26/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.26/act/LeakyRelu for ONNX node: /model.26/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.26/act/LeakyRelu_output_0 for ONNX tensor: /model.26/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.26/act/LeakyRelu [LeakyRelu] outputs: [/model.26/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.27/Concat [Concat] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.26/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.25/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.24/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.23/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.27/Concat [Concat] inputs: [/model.26/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.25/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.24/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.23/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.27/Concat for ONNX node: /model.27/Concat [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.27/Concat_output_0 for ONNX tensor: /model.27/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.27/Concat [Concat] outputs: [/model.27/Concat_output_0 -> (1, 1024, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.28/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.28/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.28/conv/_input_quantizer/Constant [Constant] outputs: [/model.28/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.28/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.28/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.28/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.28/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.28/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.27/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.28/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.28/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.28/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.27/Concat_output_0 -> (1, 1024, 20, 20)[FLOAT]], [/model.28/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.28/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.28/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.28/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.28/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.28/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.28/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.28/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.28/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.28/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 1024, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.28/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.28/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.28/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.28/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.28/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.28/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 1024, 20, 20)[FLOAT]], [/model.28/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.28/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.28/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.28/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.28/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.28/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 1024, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.28/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.28/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.28/conv/_weight_quantizer/Constant [Constant] outputs: [/model.28/conv/_weight_quantizer/Constant_output_0 -> (512)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.28/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.28/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.28/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.28/conv/_weight_quantizer/Constant_1_output_0 -> (512)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.28/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.28.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.28/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.28/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.28/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.28.conv.weight -> (512, 1024, 1, 1)[FLOAT]], [/model.28/conv/_weight_quantizer/Constant_output_0 -> (512)[FLOAT]], [/model.28/conv/_weight_quantizer/Constant_1_output_0 -> (512)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.28.conv.weight for ONNX node: model.28.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.28/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.28/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.28/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.28/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.28/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.28/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.28/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.28/conv/_weight_quantizer/QuantizeLinear_output_0 -> (512, 1024, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.28/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.28/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.28/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.28/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.28/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.28/conv/_weight_quantizer/QuantizeLinear_output_0 -> (512, 1024, 1, 1)[FLOAT]], [/model.28/conv/_weight_quantizer/Constant_output_0 -> (512)[FLOAT]], [/model.28/conv/_weight_quantizer/Constant_1_output_0 -> (512)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.28/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.28/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.28/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.28/conv/_weight_quantizer/DequantizeLinear_output_0 -> (512, 1024, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.28/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.28/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.28/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.28.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.28/conv/Conv [Conv] inputs: [/model.28/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 1024, 20, 20)[FLOAT]], [/model.28/conv/_weight_quantizer/DequantizeLinear_output_0 -> (512, 1024, 1, 1)[FLOAT]], [model.28.conv.bias -> (512)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.28/conv/Conv for ONNX node: /model.28/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.28/conv/Conv_output_0 for ONNX tensor: /model.28/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.28/conv/Conv [Conv] outputs: [/model.28/conv/Conv_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.28/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.28/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.28/act/LeakyRelu [LeakyRelu] inputs: [/model.28/conv/Conv_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.28/act/LeakyRelu for ONNX node: /model.28/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.28/act/LeakyRelu_output_0 for ONNX tensor: /model.28/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.28/act/LeakyRelu [LeakyRelu] outputs: [/model.28/act/LeakyRelu_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.29/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.29/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.29/conv/_input_quantizer/Constant [Constant] outputs: [/model.29/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.29/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.29/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.29/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.29/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.29/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.28/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.29/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.29/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.29/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.28/act/LeakyRelu_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.29/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.29/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.29/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.29/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.29/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.29/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.29/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.29/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.29/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.29/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.29/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.29/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.29/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.29/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.29/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.29/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.29/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.29/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.29/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.29/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.29/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.29/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.29/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.29/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.29/conv/_weight_quantizer/Constant [Constant] outputs: [/model.29/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.29/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.29/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.29/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.29/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.29/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.29.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.29/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.29/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.29/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.29.conv.weight -> (256, 512, 1, 1)[FLOAT]], [/model.29/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.29/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.29.conv.weight for ONNX node: model.29.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.29/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.29/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.29/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.29/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.29/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.29/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.29/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.29/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.29/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.29/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.29/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.29/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.29/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.29/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [/model.29/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.29/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.29/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.29/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.29/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.29/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.29/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.29/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.29/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.29.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.29/conv/Conv [Conv] inputs: [/model.29/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.29/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [model.29.conv.bias -> (256)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.29/conv/Conv for ONNX node: /model.29/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.29/conv/Conv_output_0 for ONNX tensor: /model.29/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.29/conv/Conv [Conv] outputs: [/model.29/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.29/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.29/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.29/act/LeakyRelu [LeakyRelu] inputs: [/model.29/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.29/act/LeakyRelu for ONNX node: /model.29/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.29/act/LeakyRelu_output_0 for ONNX tensor: /model.29/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.29/act/LeakyRelu [LeakyRelu] outputs: [/model.29/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.30/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.30/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.30/conv/_input_quantizer/Constant [Constant] outputs: [/model.30/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.30/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.30/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.30/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.30/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.30/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.28/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.30/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.30/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.30/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.28/act/LeakyRelu_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.30/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.30/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.30/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.30/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.30/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.30/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.30/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.30/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.30/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.30/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.30/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.30/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.30/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.30/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.30/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.30/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.30/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.30/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.30/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.30/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.30/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.30/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.30/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.30/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.30/conv/_weight_quantizer/Constant [Constant] outputs: [/model.30/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.30/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.30/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.30/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.30/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.30/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.30.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.30/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.30/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.30/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.30.conv.weight -> (256, 512, 1, 1)[FLOAT]], [/model.30/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.30/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.30.conv.weight for ONNX node: model.30.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.30/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.30/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.30/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.30/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.30/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.30/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.30/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.30/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.30/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.30/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.30/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.30/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.30/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.30/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [/model.30/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.30/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.30/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.30/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.30/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.30/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.30/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.30/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.30/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.30.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.30/conv/Conv [Conv] inputs: [/model.30/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.30/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [model.30.conv.bias -> (256)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.30/conv/Conv for ONNX node: /model.30/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.30/conv/Conv_output_0 for ONNX tensor: /model.30/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.30/conv/Conv [Conv] outputs: [/model.30/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.30/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.30/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.30/act/LeakyRelu [LeakyRelu] inputs: [/model.30/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.30/act/LeakyRelu for ONNX node: /model.30/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.30/act/LeakyRelu_output_0 for ONNX tensor: /model.30/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.30/act/LeakyRelu [LeakyRelu] outputs: [/model.30/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.31/m/MaxPool [MaxPool] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.30/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.31/m/MaxPool [MaxPool] inputs: [/model.30/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.31/m/MaxPool for ONNX node: /model.31/m/MaxPool [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.31/m/MaxPool_output_0 for ONNX tensor: /model.31/m/MaxPool_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.31/m/MaxPool [MaxPool] outputs: [/model.31/m/MaxPool_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.32/m/MaxPool [MaxPool] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.30/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.32/m/MaxPool [MaxPool] inputs: [/model.30/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.32/m/MaxPool for ONNX node: /model.32/m/MaxPool [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.32/m/MaxPool_output_0 for ONNX tensor: /model.32/m/MaxPool_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.32/m/MaxPool [MaxPool] outputs: [/model.32/m/MaxPool_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.33/m/MaxPool [MaxPool] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.30/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.33/m/MaxPool [MaxPool] inputs: [/model.30/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.33/m/MaxPool for ONNX node: /model.33/m/MaxPool [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.33/m/MaxPool_output_0 for ONNX tensor: /model.33/m/MaxPool_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.33/m/MaxPool [MaxPool] outputs: [/model.33/m/MaxPool_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.34/Concat [Concat] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.33/m/MaxPool_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.32/m/MaxPool_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.31/m/MaxPool_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.30/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.34/Concat [Concat] inputs: [/model.33/m/MaxPool_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.32/m/MaxPool_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.31/m/MaxPool_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.30/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.34/Concat for ONNX node: /model.34/Concat [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.34/Concat_output_0 for ONNX tensor: /model.34/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.34/Concat [Concat] outputs: [/model.34/Concat_output_0 -> (1, 1024, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.35/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.35/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.35/conv/_input_quantizer/Constant [Constant] outputs: [/model.35/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.35/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.35/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.35/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.35/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.35/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.34/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.35/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.35/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.35/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.34/Concat_output_0 -> (1, 1024, 20, 20)[FLOAT]], [/model.35/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.35/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.35/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.35/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.35/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.35/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.35/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.35/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.35/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.35/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 1024, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.35/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.35/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.35/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.35/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.35/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.35/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 1024, 20, 20)[FLOAT]], [/model.35/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.35/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.35/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.35/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.35/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.35/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 1024, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.35/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.35/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.35/conv/_weight_quantizer/Constant [Constant] outputs: [/model.35/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.35/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.35/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.35/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.35/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.35/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.35.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.35/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.35/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.35/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.35.conv.weight -> (256, 1024, 1, 1)[FLOAT]], [/model.35/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.35/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.35.conv.weight for ONNX node: model.35.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.35/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.35/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.35/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.35/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.35/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.35/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.35/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.35/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 1024, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.35/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.35/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.35/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.35/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.35/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.35/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 1024, 1, 1)[FLOAT]], [/model.35/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.35/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.35/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.35/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.35/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.35/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 1024, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.35/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.35/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.35/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.35.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.35/conv/Conv [Conv] inputs: [/model.35/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 1024, 20, 20)[FLOAT]], [/model.35/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 1024, 1, 1)[FLOAT]], [model.35.conv.bias -> (256)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.35/conv/Conv for ONNX node: /model.35/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.35/conv/Conv_output_0 for ONNX tensor: /model.35/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.35/conv/Conv [Conv] outputs: [/model.35/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.35/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.35/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.35/act/LeakyRelu [LeakyRelu] inputs: [/model.35/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.35/act/LeakyRelu for ONNX node: /model.35/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.35/act/LeakyRelu_output_0 for ONNX tensor: /model.35/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.35/act/LeakyRelu [LeakyRelu] outputs: [/model.35/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.36/Concat [Concat] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.35/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.29/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.36/Concat [Concat] inputs: [/model.35/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.29/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.36/Concat for ONNX node: /model.36/Concat [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.36/Concat_output_0 for ONNX tensor: /model.36/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.36/Concat [Concat] outputs: [/model.36/Concat_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.37/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.37/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.37/conv/_input_quantizer/Constant [Constant] outputs: [/model.37/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.37/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.37/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.37/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.37/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.37/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.36/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.37/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.37/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.37/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.36/Concat_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.37/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.37/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.37/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.37/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.37/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.37/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.37/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.37/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.37/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.37/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.37/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.37/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.37/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.37/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.37/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.37/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.37/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.37/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.37/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.37/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.37/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.37/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.37/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.37/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.37/conv/_weight_quantizer/Constant [Constant] outputs: [/model.37/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.37/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.37/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.37/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.37/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.37/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.37.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.37/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.37/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.37/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.37.conv.weight -> (256, 512, 1, 1)[FLOAT]], [/model.37/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.37/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.37.conv.weight for ONNX node: model.37.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.37/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.37/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.37/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.37/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.37/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.37/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.37/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.37/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.37/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.37/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.37/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.37/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.37/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.37/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [/model.37/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.37/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.37/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.37/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.37/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.37/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.37/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.37/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.37/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.37.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.37/conv/Conv [Conv] inputs: [/model.37/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.37/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [model.37.conv.bias -> (256)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.37/conv/Conv for ONNX node: /model.37/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.37/conv/Conv_output_0 for ONNX tensor: /model.37/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.37/conv/Conv [Conv] outputs: [/model.37/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.37/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.37/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.37/act/LeakyRelu [LeakyRelu] inputs: [/model.37/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.37/act/LeakyRelu for ONNX node: /model.37/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.37/act/LeakyRelu_output_0 for ONNX tensor: /model.37/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.37/act/LeakyRelu [LeakyRelu] outputs: [/model.37/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.38/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.38/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.38/conv/_input_quantizer/Constant [Constant] outputs: [/model.38/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.38/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.38/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.38/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.38/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.38/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.37/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.38/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.38/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.38/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.37/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.38/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.38/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.38/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.38/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.38/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.38/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.38/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.38/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.38/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.38/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.38/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.38/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.38/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.38/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.38/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.38/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.38/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.38/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.38/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.38/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.38/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.38/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.38/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.38/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.38/conv/_weight_quantizer/Constant [Constant] outputs: [/model.38/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.38/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.38/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.38/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.38/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.38/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.38.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.38/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.38/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.38/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.38.conv.weight -> (128, 256, 1, 1)[FLOAT]], [/model.38/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.38/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.38.conv.weight for ONNX node: model.38.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.38/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.38/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.38/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.38/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.38/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.38/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.38/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.38/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.38/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.38/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.38/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.38/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.38/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.38/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [/model.38/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.38/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.38/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.38/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.38/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.38/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.38/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.38/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.38/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.38.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.38/conv/Conv [Conv] inputs: [/model.38/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.38/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [model.38.conv.bias -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.38/conv/Conv for ONNX node: /model.38/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.38/conv/Conv_output_0 for ONNX tensor: /model.38/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.38/conv/Conv [Conv] outputs: [/model.38/conv/Conv_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.38/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.38/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.38/act/LeakyRelu [LeakyRelu] inputs: [/model.38/conv/Conv_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.38/act/LeakyRelu for ONNX node: /model.38/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.38/act/LeakyRelu_output_0 for ONNX tensor: /model.38/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.38/act/LeakyRelu [LeakyRelu] outputs: [/model.38/act/LeakyRelu_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.39/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.39/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.39/Constant [Constant] outputs: [/model.39/Constant_output_0 -> (4)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.39/Resize [Resize] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.38/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.39/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.39/Resize [Resize] inputs: [/model.38/act/LeakyRelu_output_0 -> (1, 128, 20, 20)[FLOAT]], [optional input, not set], [/model.39/Constant_output_0 -> (4)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.39/Resize for ONNX node: /model.39/Resize [04/18/2023-18:31:19] [V] [TRT] Running resize layer with: Transformation mode: asymmetric Resize mode: nearest [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.39/Resize_output_0 for ONNX tensor: /model.39/Resize_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.39/Resize [Resize] outputs: [/model.39/Resize_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.40/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.40/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.40/conv/_input_quantizer/Constant [Constant] outputs: [/model.40/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.40/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.40/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.40/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.40/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.40/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.21/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.40/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.40/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.40/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.21/act/LeakyRelu_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.40/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.40/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.40/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.40/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.40/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.40/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.40/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.40/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.40/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.40/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.40/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.40/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.40/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.40/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.40/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.40/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.40/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.40/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.40/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.40/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.40/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.40/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.40/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.40/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.40/conv/_weight_quantizer/Constant [Constant] outputs: [/model.40/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.40/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.40/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.40/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.40/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.40/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.40.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.40/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.40/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.40/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.40.conv.weight -> (128, 256, 1, 1)[FLOAT]], [/model.40/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.40/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.40.conv.weight for ONNX node: model.40.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.40/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.40/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.40/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.40/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.40/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.40/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.40/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.40/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.40/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.40/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.40/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.40/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.40/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.40/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [/model.40/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.40/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.40/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.40/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.40/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.40/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.40/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.40/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.40/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.40.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.40/conv/Conv [Conv] inputs: [/model.40/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.40/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [model.40.conv.bias -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.40/conv/Conv for ONNX node: /model.40/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.40/conv/Conv_output_0 for ONNX tensor: /model.40/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.40/conv/Conv [Conv] outputs: [/model.40/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.40/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.40/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.40/act/LeakyRelu [LeakyRelu] inputs: [/model.40/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.40/act/LeakyRelu for ONNX node: /model.40/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.40/act/LeakyRelu_output_0 for ONNX tensor: /model.40/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.40/act/LeakyRelu [LeakyRelu] outputs: [/model.40/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.41/Concat [Concat] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.40/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.39/Resize_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.41/Concat [Concat] inputs: [/model.40/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.39/Resize_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.41/Concat for ONNX node: /model.41/Concat [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.41/Concat_output_0 for ONNX tensor: /model.41/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.41/Concat [Concat] outputs: [/model.41/Concat_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.42/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.42/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.42/conv/_input_quantizer/Constant [Constant] outputs: [/model.42/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.42/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.42/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.42/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.42/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.42/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.41/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.42/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.42/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.42/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.41/Concat_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.42/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.42/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.42/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.42/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.42/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.42/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.42/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.42/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.42/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.42/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.42/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.42/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.42/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.42/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.42/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.42/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.42/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.42/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.42/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.42/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.42/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.42/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.42/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.42/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.42/conv/_weight_quantizer/Constant [Constant] outputs: [/model.42/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.42/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.42/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.42/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.42/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.42/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.42.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.42/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.42/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.42/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.42.conv.weight -> (64, 256, 1, 1)[FLOAT]], [/model.42/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.42/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.42.conv.weight for ONNX node: model.42.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.42/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.42/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.42/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.42/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.42/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.42/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.42/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.42/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.42/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.42/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.42/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.42/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.42/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.42/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [/model.42/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.42/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.42/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.42/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.42/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.42/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.42/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.42/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.42/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.42.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.42/conv/Conv [Conv] inputs: [/model.42/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.42/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [model.42.conv.bias -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.42/conv/Conv for ONNX node: /model.42/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.42/conv/Conv_output_0 for ONNX tensor: /model.42/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.42/conv/Conv [Conv] outputs: [/model.42/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.42/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.42/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.42/act/LeakyRelu [LeakyRelu] inputs: [/model.42/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.42/act/LeakyRelu for ONNX node: /model.42/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.42/act/LeakyRelu_output_0 for ONNX tensor: /model.42/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.42/act/LeakyRelu [LeakyRelu] outputs: [/model.42/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.43/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.43/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.43/conv/_weight_quantizer/Constant [Constant] outputs: [/model.43/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.43/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.43/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.43/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.43/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.43/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.43.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.43/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.43/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.43/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.43.conv.weight -> (64, 256, 1, 1)[FLOAT]], [/model.43/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.43/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.43.conv.weight for ONNX node: model.43.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.43/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.43/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.43/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.43/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.43/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.43/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.43/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.43/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.43/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.43/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.43/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.43/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.43/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.43/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [/model.43/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.43/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.43/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.43/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.43/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.43/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.43/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.42/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.43/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.43.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.43/conv/Conv [Conv] inputs: [/model.42/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.43/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [model.43.conv.bias -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.43/conv/Conv for ONNX node: /model.43/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.43/conv/Conv_output_0 for ONNX tensor: /model.43/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.43/conv/Conv [Conv] outputs: [/model.43/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.43/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.43/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.43/act/LeakyRelu [LeakyRelu] inputs: [/model.43/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.43/act/LeakyRelu for ONNX node: /model.43/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.43/act/LeakyRelu_output_0 for ONNX tensor: /model.43/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.43/act/LeakyRelu [LeakyRelu] outputs: [/model.43/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.44/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.44/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.44/conv/_input_quantizer/Constant [Constant] outputs: [/model.44/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.44/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.44/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.44/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.44/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.44/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.43/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.44/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.44/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.44/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.43/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.44/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.44/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.44/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.44/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.44/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.44/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.44/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.44/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.44/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.44/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.44/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.44/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.44/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.44/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.44/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.44/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.44/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.44/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.44/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.44/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.44/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.44/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.44/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.44/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.44/conv/_weight_quantizer/Constant [Constant] outputs: [/model.44/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.44/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.44/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.44/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.44/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.44/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.44.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.44/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.44/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.44/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.44.conv.weight -> (64, 64, 3, 3)[FLOAT]], [/model.44/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.44/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.44.conv.weight for ONNX node: model.44.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.44/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.44/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.44/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.44/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.44/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.44/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.44/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.44/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.44/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.44/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.44/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.44/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.44/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.44/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [/model.44/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.44/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.44/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.44/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.44/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.44/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.44/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.44/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.44/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.44.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.44/conv/Conv [Conv] inputs: [/model.44/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.44/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [model.44.conv.bias -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.44/conv/Conv for ONNX node: /model.44/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.44/conv/Conv_output_0 for ONNX tensor: /model.44/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.44/conv/Conv [Conv] outputs: [/model.44/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.44/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.44/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.44/act/LeakyRelu [LeakyRelu] inputs: [/model.44/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.44/act/LeakyRelu for ONNX node: /model.44/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.44/act/LeakyRelu_output_0 for ONNX tensor: /model.44/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.44/act/LeakyRelu [LeakyRelu] outputs: [/model.44/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.45/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.45/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.45/conv/_input_quantizer/Constant [Constant] outputs: [/model.45/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.45/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.45/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.45/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.45/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.45/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.44/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.45/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.45/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.45/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.44/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.45/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.45/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.45/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.45/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.45/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.45/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.45/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.45/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.45/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.45/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.45/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.45/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.45/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.45/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.45/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.45/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.45/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.45/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.45/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.45/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.45/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.45/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.45/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.45/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.45/conv/_weight_quantizer/Constant [Constant] outputs: [/model.45/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.45/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.45/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.45/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.45/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.45/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.45.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.45/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.45/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.45/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.45.conv.weight -> (64, 64, 3, 3)[FLOAT]], [/model.45/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.45/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.45.conv.weight for ONNX node: model.45.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.45/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.45/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.45/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.45/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.45/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.45/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.45/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.45/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.45/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.45/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.45/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.45/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.45/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.45/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [/model.45/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.45/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.45/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.45/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.45/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.45/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.45/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.45/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.45/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.45.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.45/conv/Conv [Conv] inputs: [/model.45/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.45/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [model.45.conv.bias -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.45/conv/Conv for ONNX node: /model.45/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.45/conv/Conv_output_0 for ONNX tensor: /model.45/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.45/conv/Conv [Conv] outputs: [/model.45/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.45/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.45/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.45/act/LeakyRelu [LeakyRelu] inputs: [/model.45/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.45/act/LeakyRelu for ONNX node: /model.45/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.45/act/LeakyRelu_output_0 for ONNX tensor: /model.45/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.45/act/LeakyRelu [LeakyRelu] outputs: [/model.45/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.46/Concat [Concat] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.45/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.44/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.43/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.42/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.46/Concat [Concat] inputs: [/model.45/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.44/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.43/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.42/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.46/Concat for ONNX node: /model.46/Concat [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.46/Concat_output_0 for ONNX tensor: /model.46/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.46/Concat [Concat] outputs: [/model.46/Concat_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.47/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.47/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.47/conv/_input_quantizer/Constant [Constant] outputs: [/model.47/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.47/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.47/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.47/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.47/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.47/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.46/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.47/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.47/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.47/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.46/Concat_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.47/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.47/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.47/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.47/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.47/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.47/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.47/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.47/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.47/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.47/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.47/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.47/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.47/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.47/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.47/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.47/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.47/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.47/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.47/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.47/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.47/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.47/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.47/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.47/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.47/conv/_weight_quantizer/Constant [Constant] outputs: [/model.47/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.47/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.47/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.47/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.47/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.47/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.47.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.47/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.47/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.47/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.47.conv.weight -> (128, 256, 1, 1)[FLOAT]], [/model.47/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.47/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.47.conv.weight for ONNX node: model.47.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.47/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.47/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.47/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.47/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.47/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.47/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.47/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.47/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.47/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.47/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.47/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.47/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.47/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.47/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [/model.47/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.47/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.47/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.47/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.47/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.47/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.47/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.47/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.47/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.47.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.47/conv/Conv [Conv] inputs: [/model.47/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.47/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [model.47.conv.bias -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.47/conv/Conv for ONNX node: /model.47/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.47/conv/Conv_output_0 for ONNX tensor: /model.47/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.47/conv/Conv [Conv] outputs: [/model.47/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.47/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.47/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.47/act/LeakyRelu [LeakyRelu] inputs: [/model.47/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.47/act/LeakyRelu for ONNX node: /model.47/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.47/act/LeakyRelu_output_0 for ONNX tensor: /model.47/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.47/act/LeakyRelu [LeakyRelu] outputs: [/model.47/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.48/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.48/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.48/conv/_input_quantizer/Constant [Constant] outputs: [/model.48/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.48/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.48/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.48/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.48/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.48/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.47/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.48/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.48/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.48/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.47/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.48/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.48/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.48/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.48/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.48/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.48/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.48/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.48/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.48/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.48/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.48/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.48/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.48/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.48/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.48/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.48/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.48/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.48/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.48/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.48/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.48/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.48/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.48/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.48/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.48/conv/_weight_quantizer/Constant [Constant] outputs: [/model.48/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.48/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.48/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.48/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.48/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.48/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.48.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.48/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.48/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.48/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.48.conv.weight -> (64, 128, 1, 1)[FLOAT]], [/model.48/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.48/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.48.conv.weight for ONNX node: model.48.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.48/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.48/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.48/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.48/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.48/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.48/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.48/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.48/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.48/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.48/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.48/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.48/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.48/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.48/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [/model.48/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.48/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.48/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.48/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.48/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.48/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.48/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.48/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.48/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.48.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.48/conv/Conv [Conv] inputs: [/model.48/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.48/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [model.48.conv.bias -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.48/conv/Conv for ONNX node: /model.48/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.48/conv/Conv_output_0 for ONNX tensor: /model.48/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.48/conv/Conv [Conv] outputs: [/model.48/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.48/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.48/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.48/act/LeakyRelu [LeakyRelu] inputs: [/model.48/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.48/act/LeakyRelu for ONNX node: /model.48/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.48/act/LeakyRelu_output_0 for ONNX tensor: /model.48/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.48/act/LeakyRelu [LeakyRelu] outputs: [/model.48/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.49/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.49/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.49/Constant [Constant] outputs: [/model.49/Constant_output_0 -> (4)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.49/Resize [Resize] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.48/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.49/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.49/Resize [Resize] inputs: [/model.48/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [optional input, not set], [/model.49/Constant_output_0 -> (4)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.49/Resize for ONNX node: /model.49/Resize [04/18/2023-18:31:19] [V] [TRT] Running resize layer with: Transformation mode: asymmetric Resize mode: nearest [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.49/Resize_output_0 for ONNX tensor: /model.49/Resize_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.49/Resize [Resize] outputs: [/model.49/Resize_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.50/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.50/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.50/conv/_input_quantizer/Constant [Constant] outputs: [/model.50/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.50/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.50/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.50/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.50/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.50/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.14/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.50/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.50/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.50/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.14/act/LeakyRelu_output_0 -> (1, 128, 80, 80)[FLOAT]], [/model.50/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.50/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.50/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.50/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.50/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.50/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.50/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.50/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.50/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.50/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.50/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.50/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.50/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.50/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.50/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.50/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [/model.50/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.50/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.50/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.50/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.50/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.50/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.50/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.50/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.50/conv/_weight_quantizer/Constant [Constant] outputs: [/model.50/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.50/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.50/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.50/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.50/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.50/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.50.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.50/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.50/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.50/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.50.conv.weight -> (64, 128, 1, 1)[FLOAT]], [/model.50/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.50/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.50.conv.weight for ONNX node: model.50.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.50/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.50/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.50/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.50/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.50/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.50/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.50/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.50/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.50/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.50/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.50/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.50/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.50/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.50/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [/model.50/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.50/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.50/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.50/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.50/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.50/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.50/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.50/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.50/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.50.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.50/conv/Conv [Conv] inputs: [/model.50/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [/model.50/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [model.50.conv.bias -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.50/conv/Conv for ONNX node: /model.50/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.50/conv/Conv_output_0 for ONNX tensor: /model.50/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.50/conv/Conv [Conv] outputs: [/model.50/conv/Conv_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.50/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.50/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.50/act/LeakyRelu [LeakyRelu] inputs: [/model.50/conv/Conv_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.50/act/LeakyRelu for ONNX node: /model.50/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.50/act/LeakyRelu_output_0 for ONNX tensor: /model.50/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.50/act/LeakyRelu [LeakyRelu] outputs: [/model.50/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.51/Concat [Concat] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.50/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.49/Resize_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.51/Concat [Concat] inputs: [/model.50/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.49/Resize_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.51/Concat for ONNX node: /model.51/Concat [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.51/Concat_output_0 for ONNX tensor: /model.51/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.51/Concat [Concat] outputs: [/model.51/Concat_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.52/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.52/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.52/conv/_input_quantizer/Constant [Constant] outputs: [/model.52/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.52/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.52/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.52/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.52/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.52/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.51/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.52/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.52/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.52/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.51/Concat_output_0 -> (1, 128, 80, 80)[FLOAT]], [/model.52/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.52/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.52/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.52/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.52/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.52/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.52/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.52/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.52/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.52/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.52/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.52/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.52/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.52/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.52/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.52/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [/model.52/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.52/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.52/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.52/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.52/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.52/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.52/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.52/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.52/conv/_weight_quantizer/Constant [Constant] outputs: [/model.52/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.52/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.52/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.52/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.52/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.52/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.52.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.52/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.52/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.52/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.52.conv.weight -> (32, 128, 1, 1)[FLOAT]], [/model.52/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.52/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.52.conv.weight for ONNX node: model.52.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.52/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.52/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.52/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.52/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.52/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.52/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.52/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.52/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 128, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.52/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.52/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.52/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.52/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.52/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.52/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 128, 1, 1)[FLOAT]], [/model.52/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.52/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.52/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.52/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.52/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.52/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 128, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.52/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.52/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.52/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.52.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.52/conv/Conv [Conv] inputs: [/model.52/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [/model.52/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 128, 1, 1)[FLOAT]], [model.52.conv.bias -> (32)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.52/conv/Conv for ONNX node: /model.52/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.52/conv/Conv_output_0 for ONNX tensor: /model.52/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.52/conv/Conv [Conv] outputs: [/model.52/conv/Conv_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.52/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.52/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.52/act/LeakyRelu [LeakyRelu] inputs: [/model.52/conv/Conv_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.52/act/LeakyRelu for ONNX node: /model.52/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.52/act/LeakyRelu_output_0 for ONNX tensor: /model.52/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.52/act/LeakyRelu [LeakyRelu] outputs: [/model.52/act/LeakyRelu_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.53/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.53/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.53/conv/_weight_quantizer/Constant [Constant] outputs: [/model.53/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.53/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.53/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.53/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.53/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.53/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.53.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.53/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.53/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.53/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.53.conv.weight -> (32, 128, 1, 1)[FLOAT]], [/model.53/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.53/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.53.conv.weight for ONNX node: model.53.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.53/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.53/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.53/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.53/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.53/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.53/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.53/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.53/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 128, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.53/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.53/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.53/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.53/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.53/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.53/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 128, 1, 1)[FLOAT]], [/model.53/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.53/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.53/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.53/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.53/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.53/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 128, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.53/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.52/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.53/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.53.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.53/conv/Conv [Conv] inputs: [/model.52/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [/model.53/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 128, 1, 1)[FLOAT]], [model.53.conv.bias -> (32)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.53/conv/Conv for ONNX node: /model.53/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.53/conv/Conv_output_0 for ONNX tensor: /model.53/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.53/conv/Conv [Conv] outputs: [/model.53/conv/Conv_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.53/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.53/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.53/act/LeakyRelu [LeakyRelu] inputs: [/model.53/conv/Conv_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.53/act/LeakyRelu for ONNX node: /model.53/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.53/act/LeakyRelu_output_0 for ONNX tensor: /model.53/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.53/act/LeakyRelu [LeakyRelu] outputs: [/model.53/act/LeakyRelu_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.54/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.54/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.54/conv/_input_quantizer/Constant [Constant] outputs: [/model.54/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.54/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.54/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.54/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.54/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.54/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.53/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.54/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.54/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.54/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.53/act/LeakyRelu_output_0 -> (1, 32, 80, 80)[FLOAT]], [/model.54/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.54/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.54/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.54/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.54/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.54/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.54/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.54/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.54/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.54/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.54/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.54/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.54/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.54/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.54/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.54/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 32, 80, 80)[FLOAT]], [/model.54/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.54/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.54/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.54/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.54/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.54/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.54/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.54/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.54/conv/_weight_quantizer/Constant [Constant] outputs: [/model.54/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.54/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.54/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.54/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.54/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.54/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.54.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.54/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.54/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.54/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.54.conv.weight -> (32, 32, 3, 3)[FLOAT]], [/model.54/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.54/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.54.conv.weight for ONNX node: model.54.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.54/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.54/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.54/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.54/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.54/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.54/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.54/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.54/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.54/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.54/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.54/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.54/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.54/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.54/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [/model.54/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.54/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.54/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.54/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.54/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.54/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.54/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.54/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.54/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.54.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.54/conv/Conv [Conv] inputs: [/model.54/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 32, 80, 80)[FLOAT]], [/model.54/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [model.54.conv.bias -> (32)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.54/conv/Conv for ONNX node: /model.54/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.54/conv/Conv_output_0 for ONNX tensor: /model.54/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.54/conv/Conv [Conv] outputs: [/model.54/conv/Conv_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.54/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.54/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.54/act/LeakyRelu [LeakyRelu] inputs: [/model.54/conv/Conv_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.54/act/LeakyRelu for ONNX node: /model.54/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.54/act/LeakyRelu_output_0 for ONNX tensor: /model.54/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.54/act/LeakyRelu [LeakyRelu] outputs: [/model.54/act/LeakyRelu_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.55/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.55/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.55/conv/_input_quantizer/Constant [Constant] outputs: [/model.55/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.55/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.55/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.55/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.55/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.55/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.54/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.55/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.55/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.55/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.54/act/LeakyRelu_output_0 -> (1, 32, 80, 80)[FLOAT]], [/model.55/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.55/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.55/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.55/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.55/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.55/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.55/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.55/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.55/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.55/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.55/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.55/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.55/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.55/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.55/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.55/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 32, 80, 80)[FLOAT]], [/model.55/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.55/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.55/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.55/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.55/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.55/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.55/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.55/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.55/conv/_weight_quantizer/Constant [Constant] outputs: [/model.55/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.55/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.55/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.55/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.55/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.55/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.55.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.55/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.55/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.55/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.55.conv.weight -> (32, 32, 3, 3)[FLOAT]], [/model.55/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.55/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.55.conv.weight for ONNX node: model.55.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.55/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.55/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.55/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.55/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.55/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.55/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.55/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.55/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.55/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.55/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.55/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.55/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.55/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.55/conv/_weight_quantizer/QuantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [/model.55/conv/_weight_quantizer/Constant_output_0 -> (32)[FLOAT]], [/model.55/conv/_weight_quantizer/Constant_1_output_0 -> (32)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.55/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.55/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.55/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.55/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.55/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.55/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.55/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.55.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.55/conv/Conv [Conv] inputs: [/model.55/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 32, 80, 80)[FLOAT]], [/model.55/conv/_weight_quantizer/DequantizeLinear_output_0 -> (32, 32, 3, 3)[FLOAT]], [model.55.conv.bias -> (32)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.55/conv/Conv for ONNX node: /model.55/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.55/conv/Conv_output_0 for ONNX tensor: /model.55/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.55/conv/Conv [Conv] outputs: [/model.55/conv/Conv_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.55/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.55/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.55/act/LeakyRelu [LeakyRelu] inputs: [/model.55/conv/Conv_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.55/act/LeakyRelu for ONNX node: /model.55/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.55/act/LeakyRelu_output_0 for ONNX tensor: /model.55/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.55/act/LeakyRelu [LeakyRelu] outputs: [/model.55/act/LeakyRelu_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.56/Concat [Concat] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.55/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.54/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.53/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.52/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.56/Concat [Concat] inputs: [/model.55/act/LeakyRelu_output_0 -> (1, 32, 80, 80)[FLOAT]], [/model.54/act/LeakyRelu_output_0 -> (1, 32, 80, 80)[FLOAT]], [/model.53/act/LeakyRelu_output_0 -> (1, 32, 80, 80)[FLOAT]], [/model.52/act/LeakyRelu_output_0 -> (1, 32, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.56/Concat for ONNX node: /model.56/Concat [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.56/Concat_output_0 for ONNX tensor: /model.56/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.56/Concat [Concat] outputs: [/model.56/Concat_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.57/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.57/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.57/conv/_input_quantizer/Constant [Constant] outputs: [/model.57/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.57/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.57/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.57/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.57/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.57/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.56/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.57/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.57/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.57/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.56/Concat_output_0 -> (1, 128, 80, 80)[FLOAT]], [/model.57/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.57/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.57/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.57/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.57/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.57/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.57/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.57/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.57/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.57/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.57/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.57/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.57/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.57/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.57/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.57/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [/model.57/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.57/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.57/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.57/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.57/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.57/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.57/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.57/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.57/conv/_weight_quantizer/Constant [Constant] outputs: [/model.57/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.57/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.57/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.57/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.57/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.57/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.57.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.57/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.57/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.57/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.57.conv.weight -> (64, 128, 1, 1)[FLOAT]], [/model.57/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.57/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.57.conv.weight for ONNX node: model.57.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.57/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.57/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.57/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.57/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.57/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.57/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.57/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.57/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.57/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.57/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.57/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.57/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.57/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.57/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [/model.57/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.57/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.57/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.57/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.57/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.57/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.57/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.57/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.57/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.57.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.57/conv/Conv [Conv] inputs: [/model.57/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [/model.57/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 128, 1, 1)[FLOAT]], [model.57.conv.bias -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.57/conv/Conv for ONNX node: /model.57/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.57/conv/Conv_output_0 for ONNX tensor: /model.57/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.57/conv/Conv [Conv] outputs: [/model.57/conv/Conv_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.57/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.57/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.57/act/LeakyRelu [LeakyRelu] inputs: [/model.57/conv/Conv_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.57/act/LeakyRelu for ONNX node: /model.57/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.57/act/LeakyRelu_output_0 for ONNX tensor: /model.57/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.57/act/LeakyRelu [LeakyRelu] outputs: [/model.57/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.58/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.58/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.58/conv/_input_quantizer/Constant [Constant] outputs: [/model.58/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.58/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.58/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.58/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.58/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.58/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.57/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.58/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.58/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.58/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.57/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.58/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.58/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.58/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.58/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.58/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.58/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.58/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.58/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.58/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.58/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.58/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.58/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.58/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.58/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.58/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.58/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.58/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.58/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.58/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.58/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.58/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.58/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.58/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.58/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.58/conv/_weight_quantizer/Constant [Constant] outputs: [/model.58/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.58/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.58/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.58/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.58/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.58/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.58.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.58/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.58/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.58/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.58.conv.weight -> (128, 64, 3, 3)[FLOAT]], [/model.58/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.58/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.58.conv.weight for ONNX node: model.58.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.58/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.58/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.58/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.58/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.58/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.58/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.58/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.58/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 64, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.58/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.58/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.58/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.58/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.58/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.58/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 64, 3, 3)[FLOAT]], [/model.58/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.58/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.58/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.58/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.58/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.58/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 64, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.58/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.58/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.58/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.58.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.58/conv/Conv [Conv] inputs: [/model.58/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.58/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 64, 3, 3)[FLOAT]], [model.58.conv.bias -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.58/conv/Conv for ONNX node: /model.58/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.58/conv/Conv_output_0 for ONNX tensor: /model.58/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.58/conv/Conv [Conv] outputs: [/model.58/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.58/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.58/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.58/act/LeakyRelu [LeakyRelu] inputs: [/model.58/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.58/act/LeakyRelu for ONNX node: /model.58/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.58/act/LeakyRelu_output_0 for ONNX tensor: /model.58/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.58/act/LeakyRelu [LeakyRelu] outputs: [/model.58/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.59/Concat [Concat] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.58/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.47/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.59/Concat [Concat] inputs: [/model.58/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.47/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.59/Concat for ONNX node: /model.59/Concat [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.59/Concat_output_0 for ONNX tensor: /model.59/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.59/Concat [Concat] outputs: [/model.59/Concat_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.60/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.60/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.60/conv/_input_quantizer/Constant [Constant] outputs: [/model.60/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.60/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.60/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.60/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.60/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.60/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.59/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.60/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.60/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.60/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.59/Concat_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.60/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.60/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.60/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.60/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.60/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.60/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.60/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.60/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.60/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.60/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.60/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.60/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.60/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.60/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.60/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.60/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.60/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.60/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.60/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.60/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.60/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.60/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.60/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.60/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.60/conv/_weight_quantizer/Constant [Constant] outputs: [/model.60/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.60/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.60/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.60/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.60/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.60/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.60.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.60/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.60/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.60/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.60.conv.weight -> (64, 256, 1, 1)[FLOAT]], [/model.60/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.60/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.60.conv.weight for ONNX node: model.60.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.60/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.60/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.60/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.60/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.60/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.60/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.60/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.60/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.60/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.60/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.60/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.60/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.60/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.60/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [/model.60/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.60/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.60/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.60/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.60/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.60/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.60/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.60/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.60/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.60.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.60/conv/Conv [Conv] inputs: [/model.60/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.60/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [model.60.conv.bias -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.60/conv/Conv for ONNX node: /model.60/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.60/conv/Conv_output_0 for ONNX tensor: /model.60/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.60/conv/Conv [Conv] outputs: [/model.60/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.60/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.60/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.60/act/LeakyRelu [LeakyRelu] inputs: [/model.60/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.60/act/LeakyRelu for ONNX node: /model.60/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.60/act/LeakyRelu_output_0 for ONNX tensor: /model.60/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.60/act/LeakyRelu [LeakyRelu] outputs: [/model.60/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.61/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.61/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.61/conv/_input_quantizer/Constant [Constant] outputs: [/model.61/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.61/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.61/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.61/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.61/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.61/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.59/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.61/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.61/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.61/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.59/Concat_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.61/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.61/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.61/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.61/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.61/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.61/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.61/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.61/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.61/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.61/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.61/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.61/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.61/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.61/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.61/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.61/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.61/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.61/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.61/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.61/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.61/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.61/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.61/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.61/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.61/conv/_weight_quantizer/Constant [Constant] outputs: [/model.61/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.61/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.61/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.61/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.61/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.61/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.61.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.61/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.61/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.61/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.61.conv.weight -> (64, 256, 1, 1)[FLOAT]], [/model.61/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.61/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.61.conv.weight for ONNX node: model.61.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.61/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.61/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.61/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.61/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.61/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.61/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.61/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.61/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.61/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.61/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.61/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.61/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.61/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.61/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [/model.61/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.61/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.61/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.61/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.61/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.61/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.61/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.61/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.61/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.61.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.61/conv/Conv [Conv] inputs: [/model.61/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.61/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 256, 1, 1)[FLOAT]], [model.61.conv.bias -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.61/conv/Conv for ONNX node: /model.61/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.61/conv/Conv_output_0 for ONNX tensor: /model.61/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.61/conv/Conv [Conv] outputs: [/model.61/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.61/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.61/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.61/act/LeakyRelu [LeakyRelu] inputs: [/model.61/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.61/act/LeakyRelu for ONNX node: /model.61/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.61/act/LeakyRelu_output_0 for ONNX tensor: /model.61/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.61/act/LeakyRelu [LeakyRelu] outputs: [/model.61/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.62/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.62/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.62/conv/_input_quantizer/Constant [Constant] outputs: [/model.62/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.62/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.62/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.62/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.62/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.62/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.61/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.62/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.62/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.62/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.61/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.62/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.62/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.62/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.62/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.62/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.62/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.62/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.62/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.62/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.62/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.62/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.62/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.62/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.62/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.62/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.62/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.62/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.62/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.62/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.62/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.62/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.62/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.62/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.62/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.62/conv/_weight_quantizer/Constant [Constant] outputs: [/model.62/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.62/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.62/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.62/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.62/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.62/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.62.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.62/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.62/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.62/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.62.conv.weight -> (64, 64, 3, 3)[FLOAT]], [/model.62/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.62/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.62.conv.weight for ONNX node: model.62.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.62/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.62/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.62/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.62/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.62/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.62/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.62/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.62/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.62/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.62/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.62/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.62/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.62/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.62/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [/model.62/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.62/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.62/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.62/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.62/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.62/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.62/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.62/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.62/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.62.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.62/conv/Conv [Conv] inputs: [/model.62/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.62/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [model.62.conv.bias -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.62/conv/Conv for ONNX node: /model.62/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.62/conv/Conv_output_0 for ONNX tensor: /model.62/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.62/conv/Conv [Conv] outputs: [/model.62/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.62/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.62/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.62/act/LeakyRelu [LeakyRelu] inputs: [/model.62/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.62/act/LeakyRelu for ONNX node: /model.62/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.62/act/LeakyRelu_output_0 for ONNX tensor: /model.62/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.62/act/LeakyRelu [LeakyRelu] outputs: [/model.62/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.63/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.63/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.63/conv/_input_quantizer/Constant [Constant] outputs: [/model.63/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.63/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.63/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.63/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.63/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.63/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.62/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.63/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.63/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.63/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.62/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.63/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.63/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.63/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.63/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.63/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.63/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.63/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.63/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.63/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.63/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.63/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.63/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.63/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.63/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.63/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.63/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.63/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.63/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.63/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.63/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.63/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.63/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.63/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.63/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.63/conv/_weight_quantizer/Constant [Constant] outputs: [/model.63/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.63/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.63/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.63/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.63/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.63/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.63.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.63/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.63/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.63/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.63.conv.weight -> (64, 64, 3, 3)[FLOAT]], [/model.63/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.63/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.63.conv.weight for ONNX node: model.63.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.63/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.63/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.63/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.63/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.63/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.63/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.63/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.63/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.63/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.63/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.63/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.63/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.63/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.63/conv/_weight_quantizer/QuantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [/model.63/conv/_weight_quantizer/Constant_output_0 -> (64)[FLOAT]], [/model.63/conv/_weight_quantizer/Constant_1_output_0 -> (64)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.63/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.63/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.63/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.63/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.63/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.63/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.63/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.63.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.63/conv/Conv [Conv] inputs: [/model.63/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.63/conv/_weight_quantizer/DequantizeLinear_output_0 -> (64, 64, 3, 3)[FLOAT]], [model.63.conv.bias -> (64)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.63/conv/Conv for ONNX node: /model.63/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.63/conv/Conv_output_0 for ONNX tensor: /model.63/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.63/conv/Conv [Conv] outputs: [/model.63/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.63/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.63/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.63/act/LeakyRelu [LeakyRelu] inputs: [/model.63/conv/Conv_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.63/act/LeakyRelu for ONNX node: /model.63/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.63/act/LeakyRelu_output_0 for ONNX tensor: /model.63/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.63/act/LeakyRelu [LeakyRelu] outputs: [/model.63/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.64/Concat [Concat] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.63/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.62/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.61/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.60/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.64/Concat [Concat] inputs: [/model.63/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.62/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.61/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [/model.60/act/LeakyRelu_output_0 -> (1, 64, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.64/Concat for ONNX node: /model.64/Concat [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.64/Concat_output_0 for ONNX tensor: /model.64/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.64/Concat [Concat] outputs: [/model.64/Concat_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.65/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.65/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.65/conv/_input_quantizer/Constant [Constant] outputs: [/model.65/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.65/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.65/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.65/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.65/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.65/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.64/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.65/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.65/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.65/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.64/Concat_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.65/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.65/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.65/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.65/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.65/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.65/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.65/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.65/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.65/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.65/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.65/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.65/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.65/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.65/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.65/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.65/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.65/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.65/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.65/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.65/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.65/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.65/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.65/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.65/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.65/conv/_weight_quantizer/Constant [Constant] outputs: [/model.65/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.65/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.65/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.65/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.65/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.65/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.65.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.65/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.65/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.65/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.65.conv.weight -> (128, 256, 1, 1)[FLOAT]], [/model.65/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.65/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.65.conv.weight for ONNX node: model.65.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.65/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.65/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.65/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.65/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.65/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.65/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.65/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.65/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.65/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.65/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.65/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.65/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.65/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.65/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [/model.65/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.65/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.65/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.65/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.65/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.65/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.65/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.65/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.65/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.65.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.65/conv/Conv [Conv] inputs: [/model.65/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.65/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 256, 1, 1)[FLOAT]], [model.65.conv.bias -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.65/conv/Conv for ONNX node: /model.65/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.65/conv/Conv_output_0 for ONNX tensor: /model.65/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.65/conv/Conv [Conv] outputs: [/model.65/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.65/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.65/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.65/act/LeakyRelu [LeakyRelu] inputs: [/model.65/conv/Conv_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.65/act/LeakyRelu for ONNX node: /model.65/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.65/act/LeakyRelu_output_0 for ONNX tensor: /model.65/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.65/act/LeakyRelu [LeakyRelu] outputs: [/model.65/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.66/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.66/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.66/conv/_input_quantizer/Constant [Constant] outputs: [/model.66/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.66/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.66/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.66/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.66/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.66/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.65/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.66/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.66/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.66/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.65/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.66/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.66/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.66/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.66/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.66/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.66/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.66/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.66/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.66/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.66/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.66/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.66/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.66/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.66/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.66/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.66/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.66/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.66/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.66/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.66/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.66/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.66/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.66/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.66/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.66/conv/_weight_quantizer/Constant [Constant] outputs: [/model.66/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.66/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.66/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.66/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.66/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.66/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.66.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.66/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.66/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.66/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.66.conv.weight -> (256, 128, 3, 3)[FLOAT]], [/model.66/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.66/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.66.conv.weight for ONNX node: model.66.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.66/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.66/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.66/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.66/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.66/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.66/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.66/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.66/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 128, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.66/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.66/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.66/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.66/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.66/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.66/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 128, 3, 3)[FLOAT]], [/model.66/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.66/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.66/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.66/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.66/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.66/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 128, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.66/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.66/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.66/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.66.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.66/conv/Conv [Conv] inputs: [/model.66/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.66/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 128, 3, 3)[FLOAT]], [model.66.conv.bias -> (256)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.66/conv/Conv for ONNX node: /model.66/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.66/conv/Conv_output_0 for ONNX tensor: /model.66/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.66/conv/Conv [Conv] outputs: [/model.66/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.66/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.66/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.66/act/LeakyRelu [LeakyRelu] inputs: [/model.66/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.66/act/LeakyRelu for ONNX node: /model.66/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.66/act/LeakyRelu_output_0 for ONNX tensor: /model.66/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.66/act/LeakyRelu [LeakyRelu] outputs: [/model.66/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.67/Concat [Concat] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.66/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.37/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.67/Concat [Concat] inputs: [/model.66/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.37/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.67/Concat for ONNX node: /model.67/Concat [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.67/Concat_output_0 for ONNX tensor: /model.67/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.67/Concat [Concat] outputs: [/model.67/Concat_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.68/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.68/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.68/conv/_input_quantizer/Constant [Constant] outputs: [/model.68/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.68/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.68/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.68/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.68/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.68/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.67/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.68/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.68/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.68/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.67/Concat_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.68/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.68/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.68/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.68/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.68/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.68/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.68/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.68/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.68/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.68/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.68/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.68/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.68/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.68/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.68/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.68/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.68/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.68/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.68/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.68/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.68/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.68/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.68/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.68/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.68/conv/_weight_quantizer/Constant [Constant] outputs: [/model.68/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.68/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.68/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.68/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.68/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.68/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.68.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.68/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.68/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.68/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.68.conv.weight -> (128, 512, 1, 1)[FLOAT]], [/model.68/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.68/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.68.conv.weight for ONNX node: model.68.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.68/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.68/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.68/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.68/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.68/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.68/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.68/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.68/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 512, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.68/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.68/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.68/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.68/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.68/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.68/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 512, 1, 1)[FLOAT]], [/model.68/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.68/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.68/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.68/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.68/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.68/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 512, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.68/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.68/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.68/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.68.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.68/conv/Conv [Conv] inputs: [/model.68/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.68/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 512, 1, 1)[FLOAT]], [model.68.conv.bias -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.68/conv/Conv for ONNX node: /model.68/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.68/conv/Conv_output_0 for ONNX tensor: /model.68/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.68/conv/Conv [Conv] outputs: [/model.68/conv/Conv_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.68/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.68/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.68/act/LeakyRelu [LeakyRelu] inputs: [/model.68/conv/Conv_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.68/act/LeakyRelu for ONNX node: /model.68/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.68/act/LeakyRelu_output_0 for ONNX tensor: /model.68/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.68/act/LeakyRelu [LeakyRelu] outputs: [/model.68/act/LeakyRelu_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.69/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.69/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.69/conv/_input_quantizer/Constant [Constant] outputs: [/model.69/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.69/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.69/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.69/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.69/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.69/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.67/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.69/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.69/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.69/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.67/Concat_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.69/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.69/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.69/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.69/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.69/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.69/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.69/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.69/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.69/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.69/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.69/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.69/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.69/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.69/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.69/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.69/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.69/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.69/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.69/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.69/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.69/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.69/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.69/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.69/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.69/conv/_weight_quantizer/Constant [Constant] outputs: [/model.69/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.69/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.69/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.69/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.69/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.69/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.69.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.69/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.69/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.69/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.69.conv.weight -> (128, 512, 1, 1)[FLOAT]], [/model.69/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.69/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.69.conv.weight for ONNX node: model.69.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.69/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.69/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.69/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.69/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.69/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.69/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.69/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.69/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 512, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.69/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.69/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.69/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.69/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.69/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.69/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 512, 1, 1)[FLOAT]], [/model.69/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.69/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.69/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.69/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.69/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.69/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 512, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.69/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.69/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.69/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.69.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.69/conv/Conv [Conv] inputs: [/model.69/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.69/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 512, 1, 1)[FLOAT]], [model.69.conv.bias -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.69/conv/Conv for ONNX node: /model.69/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.69/conv/Conv_output_0 for ONNX tensor: /model.69/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.69/conv/Conv [Conv] outputs: [/model.69/conv/Conv_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.69/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.69/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.69/act/LeakyRelu [LeakyRelu] inputs: [/model.69/conv/Conv_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.69/act/LeakyRelu for ONNX node: /model.69/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.69/act/LeakyRelu_output_0 for ONNX tensor: /model.69/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.69/act/LeakyRelu [LeakyRelu] outputs: [/model.69/act/LeakyRelu_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.70/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.70/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.70/conv/_input_quantizer/Constant [Constant] outputs: [/model.70/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.70/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.70/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.70/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.70/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.70/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.69/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.70/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.70/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.70/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.69/act/LeakyRelu_output_0 -> (1, 128, 20, 20)[FLOAT]], [/model.70/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.70/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.70/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.70/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.70/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.70/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.70/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.70/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.70/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.70/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.70/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.70/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.70/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.70/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.70/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.70/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 20, 20)[FLOAT]], [/model.70/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.70/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.70/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.70/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.70/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.70/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.70/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.70/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.70/conv/_weight_quantizer/Constant [Constant] outputs: [/model.70/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.70/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.70/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.70/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.70/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.70/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.70.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.70/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.70/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.70/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.70.conv.weight -> (128, 128, 3, 3)[FLOAT]], [/model.70/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.70/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.70.conv.weight for ONNX node: model.70.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.70/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.70/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.70/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.70/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.70/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.70/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.70/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.70/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.70/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.70/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.70/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.70/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.70/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.70/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [/model.70/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.70/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.70/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.70/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.70/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.70/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.70/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.70/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.70/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.70.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.70/conv/Conv [Conv] inputs: [/model.70/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 20, 20)[FLOAT]], [/model.70/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [model.70.conv.bias -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.70/conv/Conv for ONNX node: /model.70/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.70/conv/Conv_output_0 for ONNX tensor: /model.70/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.70/conv/Conv [Conv] outputs: [/model.70/conv/Conv_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.70/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.70/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.70/act/LeakyRelu [LeakyRelu] inputs: [/model.70/conv/Conv_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.70/act/LeakyRelu for ONNX node: /model.70/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.70/act/LeakyRelu_output_0 for ONNX tensor: /model.70/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.70/act/LeakyRelu [LeakyRelu] outputs: [/model.70/act/LeakyRelu_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.71/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.71/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.71/conv/_input_quantizer/Constant [Constant] outputs: [/model.71/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.71/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.71/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.71/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.71/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.71/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.70/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.71/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.71/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.71/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.70/act/LeakyRelu_output_0 -> (1, 128, 20, 20)[FLOAT]], [/model.71/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.71/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.71/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.71/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.71/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.71/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.71/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.71/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.71/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.71/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.71/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.71/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.71/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.71/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.71/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.71/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 20, 20)[FLOAT]], [/model.71/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.71/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.71/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.71/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.71/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.71/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.71/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.71/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.71/conv/_weight_quantizer/Constant [Constant] outputs: [/model.71/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.71/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.71/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.71/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.71/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.71/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.71.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.71/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.71/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.71/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.71.conv.weight -> (128, 128, 3, 3)[FLOAT]], [/model.71/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.71/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.71.conv.weight for ONNX node: model.71.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.71/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.71/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.71/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.71/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.71/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.71/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.71/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.71/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.71/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.71/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.71/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.71/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.71/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.71/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [/model.71/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.71/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.71/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.71/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.71/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.71/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.71/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.71/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.71/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.71.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.71/conv/Conv [Conv] inputs: [/model.71/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 20, 20)[FLOAT]], [/model.71/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 128, 3, 3)[FLOAT]], [model.71.conv.bias -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.71/conv/Conv for ONNX node: /model.71/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.71/conv/Conv_output_0 for ONNX tensor: /model.71/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.71/conv/Conv [Conv] outputs: [/model.71/conv/Conv_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.71/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.71/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.71/act/LeakyRelu [LeakyRelu] inputs: [/model.71/conv/Conv_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.71/act/LeakyRelu for ONNX node: /model.71/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.71/act/LeakyRelu_output_0 for ONNX tensor: /model.71/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.71/act/LeakyRelu [LeakyRelu] outputs: [/model.71/act/LeakyRelu_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.72/Concat [Concat] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.71/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.70/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.69/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.68/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.72/Concat [Concat] inputs: [/model.71/act/LeakyRelu_output_0 -> (1, 128, 20, 20)[FLOAT]], [/model.70/act/LeakyRelu_output_0 -> (1, 128, 20, 20)[FLOAT]], [/model.69/act/LeakyRelu_output_0 -> (1, 128, 20, 20)[FLOAT]], [/model.68/act/LeakyRelu_output_0 -> (1, 128, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.72/Concat for ONNX node: /model.72/Concat [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.72/Concat_output_0 for ONNX tensor: /model.72/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.72/Concat [Concat] outputs: [/model.72/Concat_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.73/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.73/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.73/conv/_input_quantizer/Constant [Constant] outputs: [/model.73/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.73/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.73/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.73/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.73/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.73/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.72/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.73/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.73/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.73/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.72/Concat_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.73/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.73/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.73/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.73/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.73/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.73/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.73/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.73/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.73/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.73/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.73/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.73/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.73/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.73/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.73/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.73/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.73/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.73/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.73/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.73/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.73/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.73/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.73/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.73/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.73/conv/_weight_quantizer/Constant [Constant] outputs: [/model.73/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.73/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.73/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.73/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.73/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.73/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.73.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.73/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.73/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.73/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.73.conv.weight -> (256, 512, 1, 1)[FLOAT]], [/model.73/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.73/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.73.conv.weight for ONNX node: model.73.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.73/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.73/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.73/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.73/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.73/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.73/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.73/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.73/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.73/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.73/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.73/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.73/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.73/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.73/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [/model.73/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.73/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.73/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.73/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.73/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.73/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.73/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.73/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.73/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.73.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.73/conv/Conv [Conv] inputs: [/model.73/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.73/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 512, 1, 1)[FLOAT]], [model.73.conv.bias -> (256)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.73/conv/Conv for ONNX node: /model.73/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.73/conv/Conv_output_0 for ONNX tensor: /model.73/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.73/conv/Conv [Conv] outputs: [/model.73/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.73/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.73/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.73/act/LeakyRelu [LeakyRelu] inputs: [/model.73/conv/Conv_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.73/act/LeakyRelu for ONNX node: /model.73/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.73/act/LeakyRelu_output_0 for ONNX tensor: /model.73/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.73/act/LeakyRelu [LeakyRelu] outputs: [/model.73/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.74/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.74/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.74/conv/_input_quantizer/Constant [Constant] outputs: [/model.74/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.74/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.74/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.74/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.74/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.74/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.57/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.74/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.74/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.74/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.57/act/LeakyRelu_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.74/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.74/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.74/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.74/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.74/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.74/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.74/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.74/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.74/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.74/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.74/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.74/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.74/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.74/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.74/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.74/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.74/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.74/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.74/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.74/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.74/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.74/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.74/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.74/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.74/conv/_weight_quantizer/Constant [Constant] outputs: [/model.74/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.74/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.74/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.74/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.74/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.74/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.74.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.74/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.74/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.74/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.74.conv.weight -> (128, 64, 3, 3)[FLOAT]], [/model.74/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.74/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.74.conv.weight for ONNX node: model.74.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.74/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.74/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.74/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.74/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.74/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.74/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.74/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.74/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 64, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.74/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.74/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.74/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.74/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.74/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.74/conv/_weight_quantizer/QuantizeLinear_output_0 -> (128, 64, 3, 3)[FLOAT]], [/model.74/conv/_weight_quantizer/Constant_output_0 -> (128)[FLOAT]], [/model.74/conv/_weight_quantizer/Constant_1_output_0 -> (128)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.74/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.74/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.74/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.74/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 64, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.74/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.74/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.74/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.74.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.74/conv/Conv [Conv] inputs: [/model.74/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 64, 80, 80)[FLOAT]], [/model.74/conv/_weight_quantizer/DequantizeLinear_output_0 -> (128, 64, 3, 3)[FLOAT]], [model.74.conv.bias -> (128)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.74/conv/Conv for ONNX node: /model.74/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.74/conv/Conv_output_0 for ONNX tensor: /model.74/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.74/conv/Conv [Conv] outputs: [/model.74/conv/Conv_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.74/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.74/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.74/act/LeakyRelu [LeakyRelu] inputs: [/model.74/conv/Conv_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.74/act/LeakyRelu for ONNX node: /model.74/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.74/act/LeakyRelu_output_0 for ONNX tensor: /model.74/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.74/act/LeakyRelu [LeakyRelu] outputs: [/model.74/act/LeakyRelu_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.75/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.75/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.75/conv/_input_quantizer/Constant [Constant] outputs: [/model.75/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.75/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.75/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.75/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.75/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.75/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.65/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.75/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.75/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.75/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.65/act/LeakyRelu_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.75/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.75/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.75/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.75/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.75/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.75/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.75/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.75/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.75/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.75/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.75/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.75/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.75/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.75/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.75/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.75/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.75/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.75/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.75/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.75/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.75/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.75/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.75/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.75/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.75/conv/_weight_quantizer/Constant [Constant] outputs: [/model.75/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.75/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.75/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.75/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.75/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.75/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.75.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.75/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.75/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.75/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.75.conv.weight -> (256, 128, 3, 3)[FLOAT]], [/model.75/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.75/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.75.conv.weight for ONNX node: model.75.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.75/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.75/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.75/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.75/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.75/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.75/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.75/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.75/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 128, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.75/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.75/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.75/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.75/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.75/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.75/conv/_weight_quantizer/QuantizeLinear_output_0 -> (256, 128, 3, 3)[FLOAT]], [/model.75/conv/_weight_quantizer/Constant_output_0 -> (256)[FLOAT]], [/model.75/conv/_weight_quantizer/Constant_1_output_0 -> (256)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.75/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.75/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.75/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.75/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 128, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.75/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.75/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.75/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.75.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.75/conv/Conv [Conv] inputs: [/model.75/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 40, 40)[FLOAT]], [/model.75/conv/_weight_quantizer/DequantizeLinear_output_0 -> (256, 128, 3, 3)[FLOAT]], [model.75.conv.bias -> (256)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.75/conv/Conv for ONNX node: /model.75/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.75/conv/Conv_output_0 for ONNX tensor: /model.75/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.75/conv/Conv [Conv] outputs: [/model.75/conv/Conv_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.75/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.75/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.75/act/LeakyRelu [LeakyRelu] inputs: [/model.75/conv/Conv_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.75/act/LeakyRelu for ONNX node: /model.75/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.75/act/LeakyRelu_output_0 for ONNX tensor: /model.75/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.75/act/LeakyRelu [LeakyRelu] outputs: [/model.75/act/LeakyRelu_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.76/conv/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.76/conv/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.76/conv/_input_quantizer/Constant [Constant] outputs: [/model.76/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.76/conv/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.76/conv/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.76/conv/_input_quantizer/Constant_1 [Constant] outputs: [/model.76/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.76/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.73/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.76/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.76/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.76/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.73/act/LeakyRelu_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.76/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.76/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.76/conv/_input_quantizer/Constant_1_output_0 for ONNX node: /model.76/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.76/conv/_input_quantizer/Constant_output_0 for ONNX node: /model.76/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.76/conv/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.76/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.76/conv/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.76/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.76/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.76/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.76/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.76/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.76/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.76/conv/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.76/conv/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.76/conv/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.76/conv/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.76/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.76/conv/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.76/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.76/conv/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.76/conv/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.76/conv/_weight_quantizer/Constant [Constant] outputs: [/model.76/conv/_weight_quantizer/Constant_output_0 -> (512)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.76/conv/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.76/conv/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.76/conv/_weight_quantizer/Constant_1 [Constant] outputs: [/model.76/conv/_weight_quantizer/Constant_1_output_0 -> (512)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.76/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.76.conv.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.76/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.76/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.76/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.76.conv.weight -> (512, 256, 3, 3)[FLOAT]], [/model.76/conv/_weight_quantizer/Constant_output_0 -> (512)[FLOAT]], [/model.76/conv/_weight_quantizer/Constant_1_output_0 -> (512)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.76.conv.weight for ONNX node: model.76.conv.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.76/conv/_weight_quantizer/Constant_output_0 for ONNX node: /model.76/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.76/conv/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.76/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.76/conv/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.76/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.76/conv/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.76/conv/_weight_quantizer/QuantizeLinear_output_0 -> (512, 256, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.76/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.76/conv/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.76/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.76/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.76/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.76/conv/_weight_quantizer/QuantizeLinear_output_0 -> (512, 256, 3, 3)[FLOAT]], [/model.76/conv/_weight_quantizer/Constant_output_0 -> (512)[FLOAT]], [/model.76/conv/_weight_quantizer/Constant_1_output_0 -> (512)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.76/conv/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.76/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.76/conv/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.76/conv/_weight_quantizer/DequantizeLinear_output_0 -> (512, 256, 3, 3)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.76/conv/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.76/conv/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.76/conv/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.76.conv.bias [04/18/2023-18:31:19] [V] [TRT] /model.76/conv/Conv [Conv] inputs: [/model.76/conv/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 20, 20)[FLOAT]], [/model.76/conv/_weight_quantizer/DequantizeLinear_output_0 -> (512, 256, 3, 3)[FLOAT]], [model.76.conv.bias -> (512)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.76/conv/Conv for ONNX node: /model.76/conv/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.76/conv/Conv_output_0 for ONNX tensor: /model.76/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.76/conv/Conv [Conv] outputs: [/model.76/conv/Conv_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.76/act/LeakyRelu [LeakyRelu] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.76/conv/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.76/act/LeakyRelu [LeakyRelu] inputs: [/model.76/conv/Conv_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.76/act/LeakyRelu for ONNX node: /model.76/act/LeakyRelu [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.76/act/LeakyRelu_output_0 for ONNX tensor: /model.76/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.76/act/LeakyRelu [LeakyRelu] outputs: [/model.76/act/LeakyRelu_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.0/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/m.0/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/m.0/_input_quantizer/Constant [Constant] outputs: [/model.77/m.0/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.0/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/m.0/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/m.0/_input_quantizer/Constant_1 [Constant] outputs: [/model.77/m.0/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.0/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.74/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.0/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.0/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.0/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.74/act/LeakyRelu_output_0 -> (1, 128, 80, 80)[FLOAT]], [/model.77/m.0/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.77/m.0/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/m.0/_input_quantizer/Constant_1_output_0 for ONNX node: /model.77/m.0/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/m.0/_input_quantizer/Constant_output_0 for ONNX node: /model.77/m.0/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/m.0/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.77/m.0/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.0/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.77/m.0/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.0/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.0/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.0/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.0/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.0/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.77/m.0/_input_quantizer/QuantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [/model.77/m.0/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.77/m.0/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/m.0/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.77/m.0/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.0/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.77/m.0/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.0/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/m.0/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/m.0/_weight_quantizer/Constant [Constant] outputs: [/model.77/m.0/_weight_quantizer/Constant_output_0 -> (255)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.0/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/m.0/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/m.0/_weight_quantizer/Constant_1 [Constant] outputs: [/model.77/m.0/_weight_quantizer/Constant_1_output_0 -> (255)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.0/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.77.m.0.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.0/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.0/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.0/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.77.m.0.weight -> (255, 128, 1, 1)[FLOAT]], [/model.77/m.0/_weight_quantizer/Constant_output_0 -> (255)[FLOAT]], [/model.77/m.0/_weight_quantizer/Constant_1_output_0 -> (255)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.77.m.0.weight for ONNX node: model.77.m.0.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/m.0/_weight_quantizer/Constant_output_0 for ONNX node: /model.77/m.0/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/m.0/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.77/m.0/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/m.0/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.77/m.0/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.0/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.77/m.0/_weight_quantizer/QuantizeLinear_output_0 -> (255, 128, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.0/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.0/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.0/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.0/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.0/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.77/m.0/_weight_quantizer/QuantizeLinear_output_0 -> (255, 128, 1, 1)[FLOAT]], [/model.77/m.0/_weight_quantizer/Constant_output_0 -> (255)[FLOAT]], [/model.77/m.0/_weight_quantizer/Constant_1_output_0 -> (255)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/m.0/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.77/m.0/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.0/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.77/m.0/_weight_quantizer/DequantizeLinear_output_0 -> (255, 128, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.0/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.0/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.0/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.77.m.0.bias [04/18/2023-18:31:19] [V] [TRT] /model.77/m.0/Conv [Conv] inputs: [/model.77/m.0/_input_quantizer/DequantizeLinear_output_0 -> (1, 128, 80, 80)[FLOAT]], [/model.77/m.0/_weight_quantizer/DequantizeLinear_output_0 -> (255, 128, 1, 1)[FLOAT]], [model.77.m.0.bias -> (255)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/m.0/Conv for ONNX node: /model.77/m.0/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/m.0/Conv_output_0 for ONNX tensor: /model.77/m.0/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.0/Conv [Conv] outputs: [/model.77/m.0/Conv_output_0 -> (1, 255, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant [Constant] outputs: [/model.77/Constant_output_0 -> (5)[INT32]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Reshape [Reshape] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.0/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Reshape [Reshape] inputs: [/model.77/m.0/Conv_output_0 -> (1, 255, 80, 80)[FLOAT]], [/model.77/Constant_output_0 -> (5)[INT32]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Reshape for ONNX node: /model.77/Reshape [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Reshape_output_0 for ONNX tensor: /model.77/Reshape_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Reshape [Reshape] outputs: [/model.77/Reshape_output_0 -> (1, 3, 85, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Transpose [Transpose] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Reshape_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Transpose [Transpose] inputs: [/model.77/Reshape_output_0 -> (1, 3, 85, 80, 80)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Transpose for ONNX node: /model.77/Transpose [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Transpose_output_0 for ONNX tensor: /model.77/Transpose_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Transpose [Transpose] outputs: [/model.77/Transpose_output_0 -> (1, 3, 80, 80, 85)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Sigmoid [Sigmoid] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Transpose_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Sigmoid [Sigmoid] inputs: [/model.77/Transpose_output_0 -> (1, 3, 80, 80, 85)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Sigmoid for ONNX node: /model.77/Sigmoid [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Sigmoid_output_0 for ONNX tensor: /model.77/Sigmoid_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Sigmoid [Sigmoid] outputs: [/model.77/Sigmoid_output_0 -> (1, 3, 80, 80, 85)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: Constant_575 [Constant] [04/18/2023-18:31:19] [V] [TRT] Constant_575 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] Constant_575 [Constant] outputs: [onnx::Split_855 -> (3)[INT32]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Split [Split] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Sigmoid_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: onnx::Split_855 [04/18/2023-18:31:19] [V] [TRT] /model.77/Split [Split] inputs: [/model.77/Sigmoid_output_0 -> (1, 3, 80, 80, 85)[FLOAT]], [onnx::Split_855 -> (3)[INT32]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Split for ONNX node: /model.77/Split [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Split_110 for ONNX node: /model.77/Split [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Split_111 for ONNX node: /model.77/Split [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Split_output_0 for ONNX tensor: /model.77/Split_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Split_output_1 for ONNX tensor: /model.77/Split_output_1 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Split_output_2 for ONNX tensor: /model.77/Split_output_2 [04/18/2023-18:31:19] [V] [TRT] /model.77/Split [Split] outputs: [/model.77/Split_output_0 -> (1, 3, 80, 80, 2)[FLOAT]], [/model.77/Split_output_1 -> (1, 3, 80, 80, 2)[FLOAT]], [/model.77/Split_output_2 -> (1, 3, 80, 80, 81)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_1 [Constant] outputs: [/model.77/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Mul [Mul] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Split_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Mul [Mul] inputs: [/model.77/Split_output_0 -> (1, 3, 80, 80, 2)[FLOAT]], [/model.77/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Constant_1_output_0 for ONNX node: /model.77/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Mul for ONNX node: /model.77/Mul [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Mul_output_0 for ONNX tensor: /model.77/Mul_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Mul [Mul] outputs: [/model.77/Mul_output_0 -> (1, 3, 80, 80, 2)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Constant_2 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_2 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_2 [Constant] outputs: [/model.77/Constant_2_output_0 -> (1, 1, 80, 80, 2)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Add [Add] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Mul_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Constant_2_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Add [Add] inputs: [/model.77/Mul_output_0 -> (1, 3, 80, 80, 2)[FLOAT]], [/model.77/Constant_2_output_0 -> (1, 1, 80, 80, 2)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Constant_2_output_0 for ONNX node: /model.77/Constant_2_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Add for ONNX node: /model.77/Add [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Add_output_0 for ONNX tensor: /model.77/Add_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Add [Add] outputs: [/model.77/Add_output_0 -> (1, 3, 80, 80, 2)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Constant_3 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_3 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_3 [Constant] outputs: [/model.77/Constant_3_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Pow [Pow] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Split_output_1 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Constant_3_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Pow [Pow] inputs: [/model.77/Split_output_1 -> (1, 3, 80, 80, 2)[FLOAT]], [/model.77/Constant_3_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Constant_3_output_0 for ONNX node: /model.77/Constant_3_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Pow for ONNX node: /model.77/Pow [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Pow_output_0 for ONNX tensor: /model.77/Pow_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Pow [Pow] outputs: [/model.77/Pow_output_0 -> (1, 3, 80, 80, 2)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Constant_4 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_4 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_4 [Constant] outputs: [/model.77/Constant_4_output_0 -> (1, 3, 1, 1, 2)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Mul_1 [Mul] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Pow_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Constant_4_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Mul_1 [Mul] inputs: [/model.77/Pow_output_0 -> (1, 3, 80, 80, 2)[FLOAT]], [/model.77/Constant_4_output_0 -> (1, 3, 1, 1, 2)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Constant_4_output_0 for ONNX node: /model.77/Constant_4_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Mul_1 for ONNX node: /model.77/Mul_1 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Mul_1_output_0 for ONNX tensor: /model.77/Mul_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Mul_1 [Mul] outputs: [/model.77/Mul_1_output_0 -> (1, 3, 80, 80, 2)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Concat [Concat] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Add_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Mul_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Split_output_2 [04/18/2023-18:31:19] [V] [TRT] /model.77/Concat [Concat] inputs: [/model.77/Add_output_0 -> (1, 3, 80, 80, 2)[FLOAT]], [/model.77/Mul_1_output_0 -> (1, 3, 80, 80, 2)[FLOAT]], [/model.77/Split_output_2 -> (1, 3, 80, 80, 81)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Concat for ONNX node: /model.77/Concat [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Concat_output_0 for ONNX tensor: /model.77/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Concat [Concat] outputs: [/model.77/Concat_output_0 -> (1, 3, 80, 80, 85)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Constant_5 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_5 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_5 [Constant] outputs: [/model.77/Constant_5_output_0 -> (3)[INT32]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Reshape_1 [Reshape] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Concat_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Constant_5_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Reshape_1 [Reshape] inputs: [/model.77/Concat_output_0 -> (1, 3, 80, 80, 85)[FLOAT]], [/model.77/Constant_5_output_0 -> (3)[INT32]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Reshape_1 for ONNX node: /model.77/Reshape_1 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Reshape_1_output_0 for ONNX tensor: /model.77/Reshape_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Reshape_1 [Reshape] outputs: [/model.77/Reshape_1_output_0 -> (1, 19200, 85)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.1/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/m.1/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/m.1/_input_quantizer/Constant [Constant] outputs: [/model.77/m.1/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.1/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/m.1/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/m.1/_input_quantizer/Constant_1 [Constant] outputs: [/model.77/m.1/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.1/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.75/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.1/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.1/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.1/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.75/act/LeakyRelu_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.77/m.1/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.77/m.1/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/m.1/_input_quantizer/Constant_1_output_0 for ONNX node: /model.77/m.1/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/m.1/_input_quantizer/Constant_output_0 for ONNX node: /model.77/m.1/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/m.1/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.77/m.1/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.1/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.77/m.1/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.1/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.1/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.1/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.1/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.1/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.77/m.1/_input_quantizer/QuantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.77/m.1/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.77/m.1/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/m.1/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.77/m.1/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.1/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.77/m.1/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.1/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/m.1/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/m.1/_weight_quantizer/Constant [Constant] outputs: [/model.77/m.1/_weight_quantizer/Constant_output_0 -> (255)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.1/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/m.1/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/m.1/_weight_quantizer/Constant_1 [Constant] outputs: [/model.77/m.1/_weight_quantizer/Constant_1_output_0 -> (255)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.1/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.77.m.1.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.1/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.1/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.1/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.77.m.1.weight -> (255, 256, 1, 1)[FLOAT]], [/model.77/m.1/_weight_quantizer/Constant_output_0 -> (255)[FLOAT]], [/model.77/m.1/_weight_quantizer/Constant_1_output_0 -> (255)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.77.m.1.weight for ONNX node: model.77.m.1.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/m.1/_weight_quantizer/Constant_output_0 for ONNX node: /model.77/m.1/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/m.1/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.77/m.1/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/m.1/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.77/m.1/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.1/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.77/m.1/_weight_quantizer/QuantizeLinear_output_0 -> (255, 256, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.1/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.1/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.1/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.1/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.1/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.77/m.1/_weight_quantizer/QuantizeLinear_output_0 -> (255, 256, 1, 1)[FLOAT]], [/model.77/m.1/_weight_quantizer/Constant_output_0 -> (255)[FLOAT]], [/model.77/m.1/_weight_quantizer/Constant_1_output_0 -> (255)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/m.1/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.77/m.1/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.1/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.77/m.1/_weight_quantizer/DequantizeLinear_output_0 -> (255, 256, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.1/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.1/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.1/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.77.m.1.bias [04/18/2023-18:31:19] [V] [TRT] /model.77/m.1/Conv [Conv] inputs: [/model.77/m.1/_input_quantizer/DequantizeLinear_output_0 -> (1, 256, 40, 40)[FLOAT]], [/model.77/m.1/_weight_quantizer/DequantizeLinear_output_0 -> (255, 256, 1, 1)[FLOAT]], [model.77.m.1.bias -> (255)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/m.1/Conv for ONNX node: /model.77/m.1/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/m.1/Conv_output_0 for ONNX tensor: /model.77/m.1/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.1/Conv [Conv] outputs: [/model.77/m.1/Conv_output_0 -> (1, 255, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Constant_6 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_6 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_6 [Constant] outputs: [/model.77/Constant_6_output_0 -> (5)[INT32]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Reshape_2 [Reshape] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.1/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Constant_6_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Reshape_2 [Reshape] inputs: [/model.77/m.1/Conv_output_0 -> (1, 255, 40, 40)[FLOAT]], [/model.77/Constant_6_output_0 -> (5)[INT32]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Reshape_2 for ONNX node: /model.77/Reshape_2 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Reshape_2_output_0 for ONNX tensor: /model.77/Reshape_2_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Reshape_2 [Reshape] outputs: [/model.77/Reshape_2_output_0 -> (1, 3, 85, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Transpose_1 [Transpose] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Reshape_2_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Transpose_1 [Transpose] inputs: [/model.77/Reshape_2_output_0 -> (1, 3, 85, 40, 40)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Transpose_1 for ONNX node: /model.77/Transpose_1 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Transpose_1_output_0 for ONNX tensor: /model.77/Transpose_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Transpose_1 [Transpose] outputs: [/model.77/Transpose_1_output_0 -> (1, 3, 40, 40, 85)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Sigmoid_1 [Sigmoid] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Transpose_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Sigmoid_1 [Sigmoid] inputs: [/model.77/Transpose_1_output_0 -> (1, 3, 40, 40, 85)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Sigmoid_1 for ONNX node: /model.77/Sigmoid_1 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Sigmoid_1_output_0 for ONNX tensor: /model.77/Sigmoid_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Sigmoid_1 [Sigmoid] outputs: [/model.77/Sigmoid_1_output_0 -> (1, 3, 40, 40, 85)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Split_1 [Split] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Sigmoid_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: onnx::Split_855 [04/18/2023-18:31:19] [V] [TRT] /model.77/Split_1 [Split] inputs: [/model.77/Sigmoid_1_output_0 -> (1, 3, 40, 40, 85)[FLOAT]], [onnx::Split_855 -> (3)[INT32]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Split_1 for ONNX node: /model.77/Split_1 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Split_1_116 for ONNX node: /model.77/Split_1 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Split_1_117 for ONNX node: /model.77/Split_1 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Split_1_output_0 for ONNX tensor: /model.77/Split_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Split_1_output_1 for ONNX tensor: /model.77/Split_1_output_1 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Split_1_output_2 for ONNX tensor: /model.77/Split_1_output_2 [04/18/2023-18:31:19] [V] [TRT] /model.77/Split_1 [Split] outputs: [/model.77/Split_1_output_0 -> (1, 3, 40, 40, 2)[FLOAT]], [/model.77/Split_1_output_1 -> (1, 3, 40, 40, 2)[FLOAT]], [/model.77/Split_1_output_2 -> (1, 3, 40, 40, 81)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Constant_7 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_7 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_7 [Constant] outputs: [/model.77/Constant_7_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Mul_2 [Mul] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Split_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Constant_7_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Mul_2 [Mul] inputs: [/model.77/Split_1_output_0 -> (1, 3, 40, 40, 2)[FLOAT]], [/model.77/Constant_7_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Constant_7_output_0 for ONNX node: /model.77/Constant_7_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Mul_2 for ONNX node: /model.77/Mul_2 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Mul_2_output_0 for ONNX tensor: /model.77/Mul_2_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Mul_2 [Mul] outputs: [/model.77/Mul_2_output_0 -> (1, 3, 40, 40, 2)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Constant_8 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_8 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_8 [Constant] outputs: [/model.77/Constant_8_output_0 -> (1, 1, 40, 40, 2)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Add_1 [Add] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Mul_2_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Constant_8_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Add_1 [Add] inputs: [/model.77/Mul_2_output_0 -> (1, 3, 40, 40, 2)[FLOAT]], [/model.77/Constant_8_output_0 -> (1, 1, 40, 40, 2)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Constant_8_output_0 for ONNX node: /model.77/Constant_8_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Add_1 for ONNX node: /model.77/Add_1 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Add_1_output_0 for ONNX tensor: /model.77/Add_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Add_1 [Add] outputs: [/model.77/Add_1_output_0 -> (1, 3, 40, 40, 2)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Constant_9 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_9 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_9 [Constant] outputs: [/model.77/Constant_9_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Pow_1 [Pow] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Split_1_output_1 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Constant_9_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Pow_1 [Pow] inputs: [/model.77/Split_1_output_1 -> (1, 3, 40, 40, 2)[FLOAT]], [/model.77/Constant_9_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Constant_9_output_0 for ONNX node: /model.77/Constant_9_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Pow_1 for ONNX node: /model.77/Pow_1 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Pow_1_output_0 for ONNX tensor: /model.77/Pow_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Pow_1 [Pow] outputs: [/model.77/Pow_1_output_0 -> (1, 3, 40, 40, 2)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Constant_10 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_10 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_10 [Constant] outputs: [/model.77/Constant_10_output_0 -> (1, 3, 1, 1, 2)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Mul_3 [Mul] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Pow_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Constant_10_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Mul_3 [Mul] inputs: [/model.77/Pow_1_output_0 -> (1, 3, 40, 40, 2)[FLOAT]], [/model.77/Constant_10_output_0 -> (1, 3, 1, 1, 2)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Constant_10_output_0 for ONNX node: /model.77/Constant_10_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Mul_3 for ONNX node: /model.77/Mul_3 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Mul_3_output_0 for ONNX tensor: /model.77/Mul_3_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Mul_3 [Mul] outputs: [/model.77/Mul_3_output_0 -> (1, 3, 40, 40, 2)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Concat_1 [Concat] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Add_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Mul_3_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Split_1_output_2 [04/18/2023-18:31:19] [V] [TRT] /model.77/Concat_1 [Concat] inputs: [/model.77/Add_1_output_0 -> (1, 3, 40, 40, 2)[FLOAT]], [/model.77/Mul_3_output_0 -> (1, 3, 40, 40, 2)[FLOAT]], [/model.77/Split_1_output_2 -> (1, 3, 40, 40, 81)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Concat_1 for ONNX node: /model.77/Concat_1 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Concat_1_output_0 for ONNX tensor: /model.77/Concat_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Concat_1 [Concat] outputs: [/model.77/Concat_1_output_0 -> (1, 3, 40, 40, 85)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Constant_11 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_11 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_11 [Constant] outputs: [/model.77/Constant_11_output_0 -> (3)[INT32]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Reshape_3 [Reshape] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Concat_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Constant_11_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Reshape_3 [Reshape] inputs: [/model.77/Concat_1_output_0 -> (1, 3, 40, 40, 85)[FLOAT]], [/model.77/Constant_11_output_0 -> (3)[INT32]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Reshape_3 for ONNX node: /model.77/Reshape_3 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Reshape_3_output_0 for ONNX tensor: /model.77/Reshape_3_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Reshape_3 [Reshape] outputs: [/model.77/Reshape_3_output_0 -> (1, 4800, 85)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.2/_input_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/m.2/_input_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/m.2/_input_quantizer/Constant [Constant] outputs: [/model.77/m.2/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.2/_input_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/m.2/_input_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/m.2/_input_quantizer/Constant_1 [Constant] outputs: [/model.77/m.2/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.2/_input_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.76/act/LeakyRelu_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.2/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.2/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.2/_input_quantizer/QuantizeLinear [QuantizeLinear] inputs: [/model.76/act/LeakyRelu_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.77/m.2/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.77/m.2/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/m.2/_input_quantizer/Constant_1_output_0 for ONNX node: /model.77/m.2/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/m.2/_input_quantizer/Constant_output_0 for ONNX node: /model.77/m.2/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/m.2/_input_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.77/m.2/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.2/_input_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.77/m.2/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.2/_input_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.2/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.2/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.2/_input_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.2/_input_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.77/m.2/_input_quantizer/QuantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.77/m.2/_input_quantizer/Constant_1_output_0 -> ()[FLOAT]], [/model.77/m.2/_input_quantizer/Constant_output_0 -> ()[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/m.2/_input_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.77/m.2/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.2/_input_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.77/m.2/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.2/_weight_quantizer/Constant [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/m.2/_weight_quantizer/Constant [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/m.2/_weight_quantizer/Constant [Constant] outputs: [/model.77/m.2/_weight_quantizer/Constant_output_0 -> (255)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.2/_weight_quantizer/Constant_1 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/m.2/_weight_quantizer/Constant_1 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/m.2/_weight_quantizer/Constant_1 [Constant] outputs: [/model.77/m.2/_weight_quantizer/Constant_1_output_0 -> (255)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.2/_weight_quantizer/QuantizeLinear [QuantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.77.m.2.weight [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.2/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.2/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.2/_weight_quantizer/QuantizeLinear [QuantizeLinear] inputs: [model.77.m.2.weight -> (255, 512, 1, 1)[FLOAT]], [/model.77/m.2/_weight_quantizer/Constant_output_0 -> (255)[FLOAT]], [/model.77/m.2/_weight_quantizer/Constant_1_output_0 -> (255)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: model.77.m.2.weight for ONNX node: model.77.m.2.weight [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/m.2/_weight_quantizer/Constant_output_0 for ONNX node: /model.77/m.2/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/m.2/_weight_quantizer/Constant_1_output_0 for ONNX node: /model.77/m.2/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/m.2/_weight_quantizer/QuantizeLinear_output_0 for ONNX tensor: /model.77/m.2/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.2/_weight_quantizer/QuantizeLinear [QuantizeLinear] outputs: [/model.77/m.2/_weight_quantizer/QuantizeLinear_output_0 -> (255, 512, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.2/_weight_quantizer/DequantizeLinear [DequantizeLinear] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.2/_weight_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.2/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.2/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.2/_weight_quantizer/DequantizeLinear [DequantizeLinear] inputs: [/model.77/m.2/_weight_quantizer/QuantizeLinear_output_0 -> (255, 512, 1, 1)[FLOAT]], [/model.77/m.2/_weight_quantizer/Constant_output_0 -> (255)[FLOAT]], [/model.77/m.2/_weight_quantizer/Constant_1_output_0 -> (255)[INT8]], [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/m.2/_weight_quantizer/DequantizeLinear_output_0 for ONNX tensor: /model.77/m.2/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.2/_weight_quantizer/DequantizeLinear [DequantizeLinear] outputs: [/model.77/m.2/_weight_quantizer/DequantizeLinear_output_0 -> (255, 512, 1, 1)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/m.2/Conv [Conv] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.2/_input_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.2/_weight_quantizer/DequantizeLinear_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: model.77.m.2.bias [04/18/2023-18:31:19] [V] [TRT] /model.77/m.2/Conv [Conv] inputs: [/model.77/m.2/_input_quantizer/DequantizeLinear_output_0 -> (1, 512, 20, 20)[FLOAT]], [/model.77/m.2/_weight_quantizer/DequantizeLinear_output_0 -> (255, 512, 1, 1)[FLOAT]], [model.77.m.2.bias -> (255)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/m.2/Conv for ONNX node: /model.77/m.2/Conv [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/m.2/Conv_output_0 for ONNX tensor: /model.77/m.2/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/m.2/Conv [Conv] outputs: [/model.77/m.2/Conv_output_0 -> (1, 255, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Constant_12 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_12 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_12 [Constant] outputs: [/model.77/Constant_12_output_0 -> (5)[INT32]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Reshape_4 [Reshape] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/m.2/Conv_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Constant_12_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Reshape_4 [Reshape] inputs: [/model.77/m.2/Conv_output_0 -> (1, 255, 20, 20)[FLOAT]], [/model.77/Constant_12_output_0 -> (5)[INT32]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Reshape_4 for ONNX node: /model.77/Reshape_4 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Reshape_4_output_0 for ONNX tensor: /model.77/Reshape_4_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Reshape_4 [Reshape] outputs: [/model.77/Reshape_4_output_0 -> (1, 3, 85, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Transpose_2 [Transpose] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Reshape_4_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Transpose_2 [Transpose] inputs: [/model.77/Reshape_4_output_0 -> (1, 3, 85, 20, 20)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Transpose_2 for ONNX node: /model.77/Transpose_2 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Transpose_2_output_0 for ONNX tensor: /model.77/Transpose_2_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Transpose_2 [Transpose] outputs: [/model.77/Transpose_2_output_0 -> (1, 3, 20, 20, 85)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Sigmoid_2 [Sigmoid] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Transpose_2_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Sigmoid_2 [Sigmoid] inputs: [/model.77/Transpose_2_output_0 -> (1, 3, 20, 20, 85)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Sigmoid_2 for ONNX node: /model.77/Sigmoid_2 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Sigmoid_2_output_0 for ONNX tensor: /model.77/Sigmoid_2_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Sigmoid_2 [Sigmoid] outputs: [/model.77/Sigmoid_2_output_0 -> (1, 3, 20, 20, 85)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Split_2 [Split] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Sigmoid_2_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: onnx::Split_855 [04/18/2023-18:31:19] [V] [TRT] /model.77/Split_2 [Split] inputs: [/model.77/Sigmoid_2_output_0 -> (1, 3, 20, 20, 85)[FLOAT]], [onnx::Split_855 -> (3)[INT32]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Split_2 for ONNX node: /model.77/Split_2 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Split_2_122 for ONNX node: /model.77/Split_2 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Split_2_123 for ONNX node: /model.77/Split_2 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Split_2_output_0 for ONNX tensor: /model.77/Split_2_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Split_2_output_1 for ONNX tensor: /model.77/Split_2_output_1 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Split_2_output_2 for ONNX tensor: /model.77/Split_2_output_2 [04/18/2023-18:31:19] [V] [TRT] /model.77/Split_2 [Split] outputs: [/model.77/Split_2_output_0 -> (1, 3, 20, 20, 2)[FLOAT]], [/model.77/Split_2_output_1 -> (1, 3, 20, 20, 2)[FLOAT]], [/model.77/Split_2_output_2 -> (1, 3, 20, 20, 81)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Constant_13 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_13 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_13 [Constant] outputs: [/model.77/Constant_13_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Mul_4 [Mul] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Split_2_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Constant_13_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Mul_4 [Mul] inputs: [/model.77/Split_2_output_0 -> (1, 3, 20, 20, 2)[FLOAT]], [/model.77/Constant_13_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Constant_13_output_0 for ONNX node: /model.77/Constant_13_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Mul_4 for ONNX node: /model.77/Mul_4 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Mul_4_output_0 for ONNX tensor: /model.77/Mul_4_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Mul_4 [Mul] outputs: [/model.77/Mul_4_output_0 -> (1, 3, 20, 20, 2)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Constant_14 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_14 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_14 [Constant] outputs: [/model.77/Constant_14_output_0 -> (1, 1, 20, 20, 2)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Add_2 [Add] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Mul_4_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Constant_14_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Add_2 [Add] inputs: [/model.77/Mul_4_output_0 -> (1, 3, 20, 20, 2)[FLOAT]], [/model.77/Constant_14_output_0 -> (1, 1, 20, 20, 2)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Constant_14_output_0 for ONNX node: /model.77/Constant_14_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Add_2 for ONNX node: /model.77/Add_2 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Add_2_output_0 for ONNX tensor: /model.77/Add_2_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Add_2 [Add] outputs: [/model.77/Add_2_output_0 -> (1, 3, 20, 20, 2)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Constant_15 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_15 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_15 [Constant] outputs: [/model.77/Constant_15_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Pow_2 [Pow] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Split_2_output_1 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Constant_15_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Pow_2 [Pow] inputs: [/model.77/Split_2_output_1 -> (1, 3, 20, 20, 2)[FLOAT]], [/model.77/Constant_15_output_0 -> ()[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Constant_15_output_0 for ONNX node: /model.77/Constant_15_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Pow_2 for ONNX node: /model.77/Pow_2 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Pow_2_output_0 for ONNX tensor: /model.77/Pow_2_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Pow_2 [Pow] outputs: [/model.77/Pow_2_output_0 -> (1, 3, 20, 20, 2)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Constant_16 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_16 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_16 [Constant] outputs: [/model.77/Constant_16_output_0 -> (1, 3, 1, 1, 2)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Mul_5 [Mul] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Pow_2_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Constant_16_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Mul_5 [Mul] inputs: [/model.77/Pow_2_output_0 -> (1, 3, 20, 20, 2)[FLOAT]], [/model.77/Constant_16_output_0 -> (1, 3, 1, 1, 2)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Constant_16_output_0 for ONNX node: /model.77/Constant_16_output_0 [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Mul_5 for ONNX node: /model.77/Mul_5 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Mul_5_output_0 for ONNX tensor: /model.77/Mul_5_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Mul_5 [Mul] outputs: [/model.77/Mul_5_output_0 -> (1, 3, 20, 20, 2)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Concat_2 [Concat] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Add_2_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Mul_5_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Split_2_output_2 [04/18/2023-18:31:19] [V] [TRT] /model.77/Concat_2 [Concat] inputs: [/model.77/Add_2_output_0 -> (1, 3, 20, 20, 2)[FLOAT]], [/model.77/Mul_5_output_0 -> (1, 3, 20, 20, 2)[FLOAT]], [/model.77/Split_2_output_2 -> (1, 3, 20, 20, 81)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Concat_2 for ONNX node: /model.77/Concat_2 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Concat_2_output_0 for ONNX tensor: /model.77/Concat_2_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Concat_2 [Concat] outputs: [/model.77/Concat_2_output_0 -> (1, 3, 20, 20, 85)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Constant_17 [Constant] [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_17 [Constant] inputs: [04/18/2023-18:31:19] [V] [TRT] /model.77/Constant_17 [Constant] outputs: [/model.77/Constant_17_output_0 -> (3)[INT32]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Reshape_5 [Reshape] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Concat_2_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Constant_17_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Reshape_5 [Reshape] inputs: [/model.77/Concat_2_output_0 -> (1, 3, 20, 20, 85)[FLOAT]], [/model.77/Constant_17_output_0 -> (3)[INT32]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Reshape_5 for ONNX node: /model.77/Reshape_5 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: /model.77/Reshape_5_output_0 for ONNX tensor: /model.77/Reshape_5_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Reshape_5 [Reshape] outputs: [/model.77/Reshape_5_output_0 -> (1, 1200, 85)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Parsing node: /model.77/Concat_3 [Concat] [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Reshape_1_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Reshape_3_output_0 [04/18/2023-18:31:19] [V] [TRT] Searching for input: /model.77/Reshape_5_output_0 [04/18/2023-18:31:19] [V] [TRT] /model.77/Concat_3 [Concat] inputs: [/model.77/Reshape_1_output_0 -> (1, 19200, 85)[FLOAT]], [/model.77/Reshape_3_output_0 -> (1, 4800, 85)[FLOAT]], [/model.77/Reshape_5_output_0 -> (1, 1200, 85)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Registering layer: /model.77/Concat_3 for ONNX node: /model.77/Concat_3 [04/18/2023-18:31:19] [V] [TRT] Registering tensor: outputs_125 for ONNX tensor: outputs [04/18/2023-18:31:19] [V] [TRT] /model.77/Concat_3 [Concat] outputs: [outputs -> (1, 25200, 85)[FLOAT]], [04/18/2023-18:31:19] [V] [TRT] Marking outputs_125 as output: outputs [04/18/2023-18:31:19] [I] Finish parsing network model [04/18/2023-18:31:20] [V] [TRT] Original: 700 layers [04/18/2023-18:31:20] [V] [TRT] After dead-layer removal: 700 layers [04/18/2023-18:31:20] [V] [TRT] Applying generic optimizations to the graph for inference. [04/18/2023-18:31:20] [V] [TRT] Running: ConstShuffleFusion on /model.77/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] ConstShuffleFusion: Fusing /model.77/Constant_1_output_0 with (Unnamed Layer* 632) [Shuffle] [04/18/2023-18:31:20] [V] [TRT] Running: ConstShuffleFusion on /model.77/Constant_3_output_0 [04/18/2023-18:31:20] [V] [TRT] ConstShuffleFusion: Fusing /model.77/Constant_3_output_0 with (Unnamed Layer* 637) [Shuffle] [04/18/2023-18:31:20] [V] [TRT] Running: ConstShuffleFusion on /model.77/Constant_7_output_0 [04/18/2023-18:31:20] [V] [TRT] ConstShuffleFusion: Fusing /model.77/Constant_7_output_0 with (Unnamed Layer* 660) [Shuffle] [04/18/2023-18:31:20] [V] [TRT] Running: ConstShuffleFusion on /model.77/Constant_9_output_0 [04/18/2023-18:31:20] [V] [TRT] ConstShuffleFusion: Fusing /model.77/Constant_9_output_0 with (Unnamed Layer* 665) [Shuffle] [04/18/2023-18:31:20] [V] [TRT] Running: ShuffleShuffleFusion on /model.77/Reshape [04/18/2023-18:31:20] [V] [TRT] ShuffleShuffleFusion: Fusing /model.77/Reshape with /model.77/Transpose [04/18/2023-18:31:20] [V] [TRT] Running: ShuffleShuffleFusion on /model.77/Reshape_2 [04/18/2023-18:31:20] [V] [TRT] ShuffleShuffleFusion: Fusing /model.77/Reshape_2 with /model.77/Transpose_1 [04/18/2023-18:31:20] [V] [TRT] Running: ShuffleShuffleFusion on /model.77/Reshape_4 [04/18/2023-18:31:20] [V] [TRT] ShuffleShuffleFusion: Fusing /model.77/Reshape_4 with /model.77/Transpose_2 [04/18/2023-18:31:20] [V] [TRT] Running: ConstShuffleFusion on /model.77/Constant_13_output_0 [04/18/2023-18:31:20] [V] [TRT] ConstShuffleFusion: Fusing /model.77/Constant_13_output_0 with (Unnamed Layer* 688) [Shuffle] [04/18/2023-18:31:20] [V] [TRT] Running: ConstShuffleFusion on /model.77/Constant_15_output_0 [04/18/2023-18:31:20] [V] [TRT] ConstShuffleFusion: Fusing /model.77/Constant_15_output_0 with (Unnamed Layer* 693) [Shuffle] [04/18/2023-18:31:20] [V] [TRT] QDQ graph optimizer - constant folding of Q/DQ initializers [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.0/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.0/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.1/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.2/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.3/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.4/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.5/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.7/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.9/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.10/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.11/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.12/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.14/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.16/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.17/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.18/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.19/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.21/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.23/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.24/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.25/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.26/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.28/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.29/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.30/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.35/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.37/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.38/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.40/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.42/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.43/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.44/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.45/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.47/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.48/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.50/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.52/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.53/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.54/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.55/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.57/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.58/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.60/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.61/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.62/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.63/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.65/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.66/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.68/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.69/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.70/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.71/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.73/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.74/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.75/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.76/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.77/m.0/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.77/m.1/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.77/m.2/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.0/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.0/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.0/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.1/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.1/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.1/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.3/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.3/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.3/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.5/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.5/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.5/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.9/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.9/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.9/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.11/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.11/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.11/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.14/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.14/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.14/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.17/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.17/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.17/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.19/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.19/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.19/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.23/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.23/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.23/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.25/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.25/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.25/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.28/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.28/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.28/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.30/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.30/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.30/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.37/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.37/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.37/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.40/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.40/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.40/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.43/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.43/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.43/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.45/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.45/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.45/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.48/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.48/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.48/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.52/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.52/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.52/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.54/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.54/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.54/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.57/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.57/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.57/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.60/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.60/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.60/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.62/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.62/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.62/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.65/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.65/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.65/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.68/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.68/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.68/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.70/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.70/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.70/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.73/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.73/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.73/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.75/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.75/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.75/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.77/m.0/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.77/m.0/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.77/m.0/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.77/m.2/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.77/m.2/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.77/m.2/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.1/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.1/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.1/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.1/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.2/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.3/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.2/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.2/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.2/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.4/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.4/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.4/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.4/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.5/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.5/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.5/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.5/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.7/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.7/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.7/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.7/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.9/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.9/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.9/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.9/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.11/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.11/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.11/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.11/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.12/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.12/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.12/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.12/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.14/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.14/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.14/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.14/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.50/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.16/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.17/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.50/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.50/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.50/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.17/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.17/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.17/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.18/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.18/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.18/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.18/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.19/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.19/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.19/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.19/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.21/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.21/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.21/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.21/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.40/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.23/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.24/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.40/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.40/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.40/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.24/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.24/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.24/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.25/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.25/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.25/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.25/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.26/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.26/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.26/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.26/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.28/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.28/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.28/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.28/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.29/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.30/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.29/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.29/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.29/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.35/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.35/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.35/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.35/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.37/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.37/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.37/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.37/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.38/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.38/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.38/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.38/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.42/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.42/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.42/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.42/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.44/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.44/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.44/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.44/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.45/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.45/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.45/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.45/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.47/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.47/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.47/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.47/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.48/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.48/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.48/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.48/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.52/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.52/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.52/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.52/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.54/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.54/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.54/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.54/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.55/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.55/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.55/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.55/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.57/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.57/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.57/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.57/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.58/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.74/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.58/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.58/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.58/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.77/m.0/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.60/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.61/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.77/m.0/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.77/m.0/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.77/m.0/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.61/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.61/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.61/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.62/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.62/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.62/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.62/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.63/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.63/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.63/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.63/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.65/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.65/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.65/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.65/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.66/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.75/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.66/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.66/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.66/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.77/m.1/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.68/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.69/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.77/m.1/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.77/m.1/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.77/m.1/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.69/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.69/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.69/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.70/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.70/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.70/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.70/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.71/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.71/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.71/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.71/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.73/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.73/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.73/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.73/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.76/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.76/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.76/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.76/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.77/m.2/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.77/m.2/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.77/m.2/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.77/m.2/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.0/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.0/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.0/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.2/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.2/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.2/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.4/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.4/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.4/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.7/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.7/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.7/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.10/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.10/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.10/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.12/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.12/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.12/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.16/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.16/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.16/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.18/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.18/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.18/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.21/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.21/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.21/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.24/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.24/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.24/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.26/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.26/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.26/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.29/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.29/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.29/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.35/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.35/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.35/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.38/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.38/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.38/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.42/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.42/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.42/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.44/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.44/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.44/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.47/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.47/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.47/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.50/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.50/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.50/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.53/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.53/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.53/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.55/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.55/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.55/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.58/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.58/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.58/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.61/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.61/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.61/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.63/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.63/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.63/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.66/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.66/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.66/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.69/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.69/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.69/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.71/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.71/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.71/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.74/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.74/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.74/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.76/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.76/conv/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.76/conv/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.77/m.1/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.77/m.1/_weight_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.77/m.1/_weight_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.3/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.3/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.3/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.16/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.16/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.16/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.23/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.23/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.23/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.30/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.30/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.30/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.74/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.74/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.74/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.60/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.60/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.60/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.75/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.75/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.75/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] Running: ConstQDQInitializersFusion on /model.68/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.68/conv/_input_quantizer/Constant_output_0 [04/18/2023-18:31:20] [V] [TRT] Removing /model.68/conv/_input_quantizer/Constant_1_output_0 [04/18/2023-18:31:20] [V] [TRT] After Myelin optimization: 465 layers [04/18/2023-18:31:20] [V] [TRT] QDQ graph optimizer - constant folding of Q/DQ initializers [04/18/2023-18:31:20] [V] [TRT] QDQ graph optimizer forward pass - DQ motions and fusions [04/18/2023-18:31:20] [V] [TRT] QDQ graph optimizer backward pass [04/18/2023-18:31:20] [V] [TRT] QDQ graph optimizer quantization pass - Generate quantized ops [04/18/2023-18:31:20] [V] [TRT] Running: SplitDQAcrossFanOut on /model.9/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.9/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: SplitDQAcrossFanOut on /model.42/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.42/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: SplitDQAcrossFanOut on /model.52/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.52/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.0.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.0.conv.weight with /model.0/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.1.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.1.conv.weight with /model.1/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.2.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.2.conv.weight with /model.2/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.3.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.3.conv.weight with /model.3/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.4.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.4.conv.weight with /model.4/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.5.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.5.conv.weight with /model.5/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.7.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.7.conv.weight with /model.7/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.9.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.9.conv.weight with /model.9/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.10.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.10.conv.weight with /model.10/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.11.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.11.conv.weight with /model.11/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.12.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.12.conv.weight with /model.12/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.14.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.14.conv.weight with /model.14/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.16.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.16.conv.weight with /model.16/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.17.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.17.conv.weight with /model.17/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.18.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.18.conv.weight with /model.18/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.19.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.19.conv.weight with /model.19/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.21.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.21.conv.weight with /model.21/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.23.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.23.conv.weight with /model.23/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.24.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.24.conv.weight with /model.24/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.25.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.25.conv.weight with /model.25/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.26.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.26.conv.weight with /model.26/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.28.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.28.conv.weight with /model.28/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.29.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.29.conv.weight with /model.29/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.30.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.30.conv.weight with /model.30/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.35.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.35.conv.weight with /model.35/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.37.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.37.conv.weight with /model.37/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.38.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.38.conv.weight with /model.38/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.40.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.40.conv.weight with /model.40/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.42.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.42.conv.weight with /model.42/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.43.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.43.conv.weight with /model.43/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.44.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.44.conv.weight with /model.44/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.45.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.45.conv.weight with /model.45/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.47.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.47.conv.weight with /model.47/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.48.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.48.conv.weight with /model.48/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.50.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.50.conv.weight with /model.50/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.52.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.52.conv.weight with /model.52/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.53.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.53.conv.weight with /model.53/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.54.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.54.conv.weight with /model.54/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.55.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.55.conv.weight with /model.55/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.57.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.57.conv.weight with /model.57/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.58.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.58.conv.weight with /model.58/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.60.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.60.conv.weight with /model.60/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.61.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.61.conv.weight with /model.61/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.62.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.62.conv.weight with /model.62/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.63.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.63.conv.weight with /model.63/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.65.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.65.conv.weight with /model.65/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.66.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.66.conv.weight with /model.66/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.68.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.68.conv.weight with /model.68/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.69.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.69.conv.weight with /model.69/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.70.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.70.conv.weight with /model.70/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.71.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.71.conv.weight with /model.71/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.73.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.73.conv.weight with /model.73/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.74.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.74.conv.weight with /model.74/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.75.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.75.conv.weight with /model.75/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.76.conv.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.76.conv.weight with /model.76/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.77.m.0.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.77.m.0.weight with /model.77/m.0/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.77.m.1.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.77.m.1.weight with /model.77/m.1/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstWeightsQuantizeFusion on model.77.m.2.weight [04/18/2023-18:31:20] [V] [TRT] ConstWeightsQuantizeFusion: Fusing model.77.m.2.weight with /model.77/m.2/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: ConstEltFusion on /model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] [04/18/2023-18:31:20] [V] [TRT] ConstEltFusion: Fusing /model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] with /model.77/Mul [04/18/2023-18:31:20] [V] [TRT] Running: ConstEltFusion on /model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] [04/18/2023-18:31:20] [V] [TRT] ConstEltFusion: Fusing /model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] with /model.77/Mul_2 [04/18/2023-18:31:20] [V] [TRT] Running: ConstEltFusion on /model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] [04/18/2023-18:31:20] [V] [TRT] ConstEltFusion: Fusing /model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] with /model.77/Mul_4 [04/18/2023-18:31:20] [V] [TRT] Running: VanillaSwapWithFollowingQ on /model.8/m/MaxPool [04/18/2023-18:31:20] [V] [TRT] Swapping /model.8/m/MaxPool with /model.9/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: HorizontalMergeQNodes on /model.2/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Eliminating /model.3/conv/_input_quantizer/QuantizeLinear which duplicates (Q) /model.2/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.3/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: HorizontalMergeQNodes on /model.29/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Eliminating /model.30/conv/_input_quantizer/QuantizeLinear which duplicates (Q) /model.29/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.30/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: HorizontalMergeQNodes on /model.58/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Eliminating /model.74/conv/_input_quantizer/QuantizeLinear which duplicates (Q) /model.58/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.74/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Running: HorizontalMergeQNodes on /model.66/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Eliminating /model.75/conv/_input_quantizer/QuantizeLinear which duplicates (Q) /model.66/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:20] [V] [TRT] Removing /model.75/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Running: SplitQAcrossPrecedingFanIn on /model.6/Concat [04/18/2023-18:31:21] [V] [TRT] Running: SplitQAcrossPrecedingFanIn on /model.13/Concat [04/18/2023-18:31:21] [V] [TRT] Running: SplitQAcrossPrecedingFanIn on /model.20/Concat [04/18/2023-18:31:21] [V] [TRT] Running: SplitQAcrossPrecedingFanIn on /model.27/Concat [04/18/2023-18:31:21] [V] [TRT] Running: SplitQAcrossPrecedingFanIn on /model.34/Concat [04/18/2023-18:31:21] [V] [TRT] Running: SplitQAcrossPrecedingFanIn on /model.36/Concat [04/18/2023-18:31:21] [V] [TRT] Running: SplitQAcrossPrecedingFanIn on /model.41/Concat [04/18/2023-18:31:21] [V] [TRT] Running: SplitQAcrossPrecedingFanIn on /model.46/Concat [04/18/2023-18:31:21] [V] [TRT] Running: SplitQAcrossPrecedingFanIn on /model.51/Concat [04/18/2023-18:31:21] [V] [TRT] Running: SplitQAcrossPrecedingFanIn on /model.56/Concat [04/18/2023-18:31:21] [V] [TRT] Running: SplitQAcrossPrecedingFanIn on /model.64/Concat [04/18/2023-18:31:21] [V] [TRT] Running: SplitQAcrossPrecedingFanIn on /model.72/Concat [04/18/2023-18:31:21] [V] [TRT] Running: VanillaSwapWithFollowingQ on /model.31/m/MaxPool [04/18/2023-18:31:21] [V] [TRT] Swapping /model.31/m/MaxPool with /model.35/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-18:31:21] [V] [TRT] Running: VanillaSwapWithFollowingQ on /model.32/m/MaxPool [04/18/2023-18:31:21] [V] [TRT] Swapping /model.32/m/MaxPool with /model.35/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-18:31:21] [V] [TRT] Running: VanillaSwapWithFollowingQ on /model.33/m/MaxPool [04/18/2023-18:31:21] [V] [TRT] Swapping /model.33/m/MaxPool with /model.35/conv/_input_quantizer/QuantizeLinear_clone_0 [04/18/2023-18:31:21] [V] [TRT] Running: VanillaSwapWithFollowingQ on /model.39/Resize [04/18/2023-18:31:21] [V] [TRT] Swapping /model.39/Resize with /model.42/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-18:31:21] [V] [TRT] Running: VanillaSwapWithFollowingQ on /model.49/Resize [04/18/2023-18:31:21] [V] [TRT] Swapping /model.49/Resize with /model.52/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-18:31:21] [V] [TRT] Running: HorizontalMergeQNodes on /model.4/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Eliminating /model.7/conv/_input_quantizer/QuantizeLinear_clone_2 which duplicates (Q) /model.4/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Removing /model.7/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-18:31:21] [V] [TRT] Running: HorizontalMergeQNodes on /model.5/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Eliminating /model.7/conv/_input_quantizer/QuantizeLinear_clone_1 which duplicates (Q) /model.5/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Removing /model.7/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-18:31:21] [V] [TRT] Running: HorizontalMergeQNodes on /model.11/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Eliminating /model.14/conv/_input_quantizer/QuantizeLinear_clone_2 which duplicates (Q) /model.11/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Removing /model.14/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-18:31:21] [V] [TRT] Running: HorizontalMergeQNodes on /model.12/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Eliminating /model.14/conv/_input_quantizer/QuantizeLinear_clone_1 which duplicates (Q) /model.12/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Removing /model.14/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-18:31:21] [V] [TRT] Running: HorizontalMergeQNodes on /model.18/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Eliminating /model.21/conv/_input_quantizer/QuantizeLinear_clone_2 which duplicates (Q) /model.18/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Removing /model.21/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-18:31:21] [V] [TRT] Running: HorizontalMergeQNodes on /model.19/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Eliminating /model.21/conv/_input_quantizer/QuantizeLinear_clone_1 which duplicates (Q) /model.19/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Removing /model.21/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-18:31:21] [V] [TRT] Running: HorizontalMergeQNodes on /model.25/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Eliminating /model.28/conv/_input_quantizer/QuantizeLinear_clone_2 which duplicates (Q) /model.25/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Removing /model.28/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-18:31:21] [V] [TRT] Running: HorizontalMergeQNodes on /model.26/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Eliminating /model.28/conv/_input_quantizer/QuantizeLinear_clone_1 which duplicates (Q) /model.26/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Removing /model.28/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-18:31:21] [V] [TRT] Running: HorizontalMergeQNodes on /model.35/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-18:31:21] [V] [TRT] Eliminating /model.35/conv/_input_quantizer/QuantizeLinear_clone_3 which duplicates (Q) /model.35/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-18:31:21] [V] [TRT] Eliminating /model.35/conv/_input_quantizer/QuantizeLinear_clone_1 which duplicates (Q) /model.35/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-18:31:21] [V] [TRT] Eliminating /model.35/conv/_input_quantizer/QuantizeLinear_clone_0 which duplicates (Q) /model.35/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-18:31:21] [V] [TRT] Removing /model.35/conv/_input_quantizer/QuantizeLinear_clone_3 [04/18/2023-18:31:21] [V] [TRT] Removing /model.35/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-18:31:21] [V] [TRT] Removing /model.35/conv/_input_quantizer/QuantizeLinear_clone_0 [04/18/2023-18:31:21] [V] [TRT] Running: HorizontalMergeQNodes on /model.44/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Eliminating /model.47/conv/_input_quantizer/QuantizeLinear_clone_2 which duplicates (Q) /model.44/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Removing /model.47/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-18:31:21] [V] [TRT] Running: HorizontalMergeQNodes on /model.45/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Eliminating /model.47/conv/_input_quantizer/QuantizeLinear_clone_1 which duplicates (Q) /model.45/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Removing /model.47/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-18:31:21] [V] [TRT] Running: HorizontalMergeQNodes on /model.54/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Eliminating /model.57/conv/_input_quantizer/QuantizeLinear_clone_2 which duplicates (Q) /model.54/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Removing /model.57/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-18:31:21] [V] [TRT] Running: HorizontalMergeQNodes on /model.55/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Eliminating /model.57/conv/_input_quantizer/QuantizeLinear_clone_1 which duplicates (Q) /model.55/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Removing /model.57/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-18:31:21] [V] [TRT] Running: HorizontalMergeQNodes on /model.62/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Eliminating /model.65/conv/_input_quantizer/QuantizeLinear_clone_2 which duplicates (Q) /model.62/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Removing /model.65/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-18:31:21] [V] [TRT] Running: HorizontalMergeQNodes on /model.63/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Eliminating /model.65/conv/_input_quantizer/QuantizeLinear_clone_1 which duplicates (Q) /model.63/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Removing /model.65/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-18:31:21] [V] [TRT] Running: HorizontalMergeQNodes on /model.70/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Eliminating /model.73/conv/_input_quantizer/QuantizeLinear_clone_2 which duplicates (Q) /model.70/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Removing /model.73/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-18:31:21] [V] [TRT] Running: HorizontalMergeQNodes on /model.71/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Eliminating /model.73/conv/_input_quantizer/QuantizeLinear_clone_1 which duplicates (Q) /model.71/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:21] [V] [TRT] Removing /model.73/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-18:31:21] [V] [TRT] Running: PointWiseFusion on /model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle] [04/18/2023-18:31:21] [V] [TRT] PointWiseFusion: Fusing /model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle] with /model.77/Pow [04/18/2023-18:31:21] [V] [TRT] Running: PointWiseFusion on /model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle] [04/18/2023-18:31:21] [V] [TRT] PointWiseFusion: Fusing /model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle] with /model.77/Pow_1 [04/18/2023-18:31:21] [V] [TRT] Running: PointWiseFusion on /model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul [04/18/2023-18:31:21] [V] [TRT] PointWiseFusion: Fusing /model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul with /model.77/Add [04/18/2023-18:31:21] [V] [TRT] Running: PointWiseFusion on PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow) [04/18/2023-18:31:21] [V] [TRT] PointWiseFusion: Fusing PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow) with /model.77/Mul_1 [04/18/2023-18:31:21] [V] [TRT] Running: PointWiseFusion on /model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2 [04/18/2023-18:31:21] [V] [TRT] PointWiseFusion: Fusing /model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2 with /model.77/Add_1 [04/18/2023-18:31:21] [V] [TRT] Running: PointWiseFusion on PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1) [04/18/2023-18:31:21] [V] [TRT] PointWiseFusion: Fusing PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1) with /model.77/Mul_3 [04/18/2023-18:31:21] [V] [TRT] Running: PointWiseFusion on /model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4 [04/18/2023-18:31:21] [V] [TRT] PointWiseFusion: Fusing /model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4 with /model.77/Add_2 [04/18/2023-18:31:21] [V] [TRT] Running: PointWiseFusion on /model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle] [04/18/2023-18:31:21] [V] [TRT] PointWiseFusion: Fusing /model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle] with /model.77/Pow_2 [04/18/2023-18:31:21] [V] [TRT] Running: PointWiseFusion on PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2) [04/18/2023-18:31:21] [V] [TRT] PointWiseFusion: Fusing PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2) with /model.77/Mul_5 [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.0/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.0/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.1/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.1/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.2/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.2/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.3/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.3/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.4/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.4/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.5/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.5/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.7/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.7/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.9/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.9/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.10/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.10/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.11/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.11/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.12/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.12/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.14/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.14/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.50/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.50/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.16/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.16/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.17/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.17/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.18/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.18/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.19/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.19/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.21/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.21/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.40/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.40/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.23/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.23/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.24/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.24/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.25/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.25/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.26/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.26/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.28/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.28/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.29/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.29/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.30/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.30/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.35/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.35/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.37/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.37/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.38/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.38/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.42/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.42/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.43/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.43/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.44/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.44/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.45/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.45/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.47/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.47/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.48/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.48/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.52/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.52/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.53/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.53/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.54/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.54/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.55/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.55/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.57/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.57/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.58/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.58/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.74/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.74/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.60/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.60/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.61/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.61/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.77/Sigmoid [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.77/Sigmoid from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.62/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.62/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.63/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.63/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.65/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.65/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.66/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.66/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.75/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.75/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.68/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.68/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.69/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.69/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.77/Sigmoid_1 [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.77/Sigmoid_1 from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.70/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.70/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.71/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.71/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.73/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.73/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.76/act/LeakyRelu [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.76/act/LeakyRelu from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ActivationToPointwiseConversion on /model.77/Sigmoid_2 [04/18/2023-18:31:21] [V] [TRT] Swap the layer type of /model.77/Sigmoid_2 from ACTIVATION to POINTWISE [04/18/2023-18:31:21] [V] [TRT] Running: ShufflePointWiseSwap on /model.77/Reshape + /model.77/Transpose [04/18/2023-18:31:21] [V] [TRT] Swapping /model.77/Reshape + /model.77/Transpose with PWN(/model.77/Sigmoid) [04/18/2023-18:31:21] [V] [TRT] Running: ShufflePointWiseSwap on /model.77/Reshape_2 + /model.77/Transpose_1 [04/18/2023-18:31:21] [V] [TRT] Swapping /model.77/Reshape_2 + /model.77/Transpose_1 with PWN(/model.77/Sigmoid_1) [04/18/2023-18:31:21] [V] [TRT] Running: ShufflePointWiseSwap on /model.77/Reshape_4 + /model.77/Transpose_2 [04/18/2023-18:31:21] [V] [TRT] Swapping /model.77/Reshape_4 + /model.77/Transpose_2 with PWN(/model.77/Sigmoid_2) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.1/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.1/conv/Conv with PWN(/model.1/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.2/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.2/conv/Conv with PWN(/model.2/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.3/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.3/conv/Conv with PWN(/model.3/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.4/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.4/conv/Conv with PWN(/model.4/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.5/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.5/conv/Conv with PWN(/model.5/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.7/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.7/conv/Conv with PWN(/model.7/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.9/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.9/conv/Conv with PWN(/model.9/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.10/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.10/conv/Conv with PWN(/model.10/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.11/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.11/conv/Conv with PWN(/model.11/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.12/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.12/conv/Conv with PWN(/model.12/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.14/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.14/conv/Conv with PWN(/model.14/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.50/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.50/conv/Conv with PWN(/model.50/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.16/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.16/conv/Conv with PWN(/model.16/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.17/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.17/conv/Conv with PWN(/model.17/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.18/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.18/conv/Conv with PWN(/model.18/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.19/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.19/conv/Conv with PWN(/model.19/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.21/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.21/conv/Conv with PWN(/model.21/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.40/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.40/conv/Conv with PWN(/model.40/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.23/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.23/conv/Conv with PWN(/model.23/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.24/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.24/conv/Conv with PWN(/model.24/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.25/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.25/conv/Conv with PWN(/model.25/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.26/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.26/conv/Conv with PWN(/model.26/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.28/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.28/conv/Conv with PWN(/model.28/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.29/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.29/conv/Conv with PWN(/model.29/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.30/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.30/conv/Conv with PWN(/model.30/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.35/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.35/conv/Conv with PWN(/model.35/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.37/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.37/conv/Conv with PWN(/model.37/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.38/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.38/conv/Conv with PWN(/model.38/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.42/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.42/conv/Conv with PWN(/model.42/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.43/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.43/conv/Conv with PWN(/model.43/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.44/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.44/conv/Conv with PWN(/model.44/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.45/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.45/conv/Conv with PWN(/model.45/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.47/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.47/conv/Conv with PWN(/model.47/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.48/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.48/conv/Conv with PWN(/model.48/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.52/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.52/conv/Conv with PWN(/model.52/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.53/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.53/conv/Conv with PWN(/model.53/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.54/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.54/conv/Conv with PWN(/model.54/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.55/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.55/conv/Conv with PWN(/model.55/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.57/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.57/conv/Conv with PWN(/model.57/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.58/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.58/conv/Conv with PWN(/model.58/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.74/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.74/conv/Conv with PWN(/model.74/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.60/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.60/conv/Conv with PWN(/model.60/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.61/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.61/conv/Conv with PWN(/model.61/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.62/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.62/conv/Conv with PWN(/model.62/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.63/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.63/conv/Conv with PWN(/model.63/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.65/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.65/conv/Conv with PWN(/model.65/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.66/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.66/conv/Conv with PWN(/model.66/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.75/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.75/conv/Conv with PWN(/model.75/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.68/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.68/conv/Conv with PWN(/model.68/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.69/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.69/conv/Conv with PWN(/model.69/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.70/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.70/conv/Conv with PWN(/model.70/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.71/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.71/conv/Conv with PWN(/model.71/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.73/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.73/conv/Conv with PWN(/model.73/act/LeakyRelu) [04/18/2023-18:31:21] [V] [TRT] Running: GenericConvActFusion on /model.76/conv/Conv [04/18/2023-18:31:21] [V] [TRT] GenericConvActFusion: Fusing /model.76/conv/Conv with PWN(/model.76/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.0/conv/Conv [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.0/conv/_input_quantizer/DequantizeLinear and /model.0/conv/_weight_quantizer/DequantizeLinear) into /model.0/conv/Conv [04/18/2023-18:31:22] [V] [TRT] Removing /model.0/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.0/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.2/conv/_input_quantizer/QuantizeLinear into /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.1/conv/_input_quantizer/DequantizeLinear and /model.1/conv/_weight_quantizer/DequantizeLinear) into /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.2/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.1/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.1/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.7/conv/_input_quantizer/QuantizeLinear_clone_3 into /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.2/conv/_input_quantizer/DequantizeLinear and /model.2/conv/_weight_quantizer/DequantizeLinear) into /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.7/conv/_input_quantizer/QuantizeLinear_clone_3 [04/18/2023-18:31:22] [V] [TRT] Removing /model.2/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.2/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.5/conv/_input_quantizer/QuantizeLinear into /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.4/conv/_input_quantizer/DequantizeLinear and /model.4/conv/_weight_quantizer/DequantizeLinear) into /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.5/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.4/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.4/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.7/conv/_input_quantizer/QuantizeLinear_clone_0 into /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.5/conv/_input_quantizer/DequantizeLinear and /model.5/conv/_weight_quantizer/DequantizeLinear) into /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.7/conv/_input_quantizer/QuantizeLinear_clone_0 [04/18/2023-18:31:22] [V] [TRT] Removing /model.5/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.5/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.9/conv/_input_quantizer/QuantizeLinear into /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.7/conv/_input_quantizer/DequantizeLinear and /model.7/conv/_weight_quantizer/DequantizeLinear) into /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.9/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.7/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.7/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.14/conv/_input_quantizer/QuantizeLinear_clone_3 into /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.9/conv/_input_quantizer/DequantizeLinear_clone_0 and /model.9/conv/_weight_quantizer/DequantizeLinear) into /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.14/conv/_input_quantizer/QuantizeLinear_clone_3 [04/18/2023-18:31:22] [V] [TRT] Removing /model.9/conv/_input_quantizer/DequantizeLinear_clone_0 [04/18/2023-18:31:22] [V] [TRT] Removing /model.9/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.12/conv/_input_quantizer/QuantizeLinear into /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.11/conv/_input_quantizer/DequantizeLinear and /model.11/conv/_weight_quantizer/DequantizeLinear) into /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.12/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.11/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.11/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.14/conv/_input_quantizer/QuantizeLinear_clone_0 into /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.12/conv/_input_quantizer/DequantizeLinear and /model.12/conv/_weight_quantizer/DequantizeLinear) into /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.14/conv/_input_quantizer/QuantizeLinear_clone_0 [04/18/2023-18:31:22] [V] [TRT] Removing /model.12/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.12/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.14/conv/_input_quantizer/DequantizeLinear and /model.14/conv/_weight_quantizer/DequantizeLinear) into /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.14/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.14/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.52/conv/_input_quantizer/QuantizeLinear_clone_0 into /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.50/conv/_input_quantizer/DequantizeLinear and /model.50/conv/_weight_quantizer/DequantizeLinear) into /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.52/conv/_input_quantizer/QuantizeLinear_clone_0 [04/18/2023-18:31:22] [V] [TRT] Removing /model.50/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.50/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.18/conv/_input_quantizer/QuantizeLinear into /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.17/conv/_input_quantizer/DequantizeLinear and /model.17/conv/_weight_quantizer/DequantizeLinear) into /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.18/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.17/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.17/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.19/conv/_input_quantizer/QuantizeLinear into /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.18/conv/_input_quantizer/DequantizeLinear and /model.18/conv/_weight_quantizer/DequantizeLinear) into /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.19/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.18/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.18/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.21/conv/_input_quantizer/QuantizeLinear_clone_0 into /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.19/conv/_input_quantizer/DequantizeLinear and /model.19/conv/_weight_quantizer/DequantizeLinear) into /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.21/conv/_input_quantizer/QuantizeLinear_clone_0 [04/18/2023-18:31:22] [V] [TRT] Removing /model.19/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.19/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.21/conv/_input_quantizer/DequantizeLinear and /model.21/conv/_weight_quantizer/DequantizeLinear) into /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.21/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.21/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.42/conv/_input_quantizer/QuantizeLinear_clone_0 into /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.40/conv/_input_quantizer/DequantizeLinear and /model.40/conv/_weight_quantizer/DequantizeLinear) into /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.42/conv/_input_quantizer/QuantizeLinear_clone_0 [04/18/2023-18:31:22] [V] [TRT] Removing /model.40/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.40/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.25/conv/_input_quantizer/QuantizeLinear into /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.24/conv/_input_quantizer/DequantizeLinear and /model.24/conv/_weight_quantizer/DequantizeLinear) into /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.25/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.24/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.24/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.26/conv/_input_quantizer/QuantizeLinear into /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.25/conv/_input_quantizer/DequantizeLinear and /model.25/conv/_weight_quantizer/DequantizeLinear) into /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.26/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.25/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.25/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.28/conv/_input_quantizer/QuantizeLinear_clone_0 into /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.26/conv/_input_quantizer/DequantizeLinear and /model.26/conv/_weight_quantizer/DequantizeLinear) into /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.28/conv/_input_quantizer/QuantizeLinear_clone_0 [04/18/2023-18:31:22] [V] [TRT] Removing /model.26/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.26/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.29/conv/_input_quantizer/QuantizeLinear into /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.28/conv/_input_quantizer/DequantizeLinear and /model.28/conv/_weight_quantizer/DequantizeLinear) into /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.29/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.28/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.28/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.37/conv/_input_quantizer/QuantizeLinear_clone_1 into /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.29/conv/_input_quantizer/DequantizeLinear and /model.29/conv/_weight_quantizer/DequantizeLinear) into /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.37/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-18:31:22] [V] [TRT] Removing /model.29/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.29/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.37/conv/_input_quantizer/QuantizeLinear_clone_0 into /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.35/conv/_input_quantizer/DequantizeLinear and /model.35/conv/_weight_quantizer/DequantizeLinear) into /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.37/conv/_input_quantizer/QuantizeLinear_clone_0 [04/18/2023-18:31:22] [V] [TRT] Removing /model.35/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.35/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.37/conv/_input_quantizer/DequantizeLinear and /model.37/conv/_weight_quantizer/DequantizeLinear) into /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.37/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.37/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.42/conv/_input_quantizer/QuantizeLinear_clone_1 into /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.38/conv/_input_quantizer/DequantizeLinear and /model.38/conv/_weight_quantizer/DequantizeLinear) into /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.42/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-18:31:22] [V] [TRT] Removing /model.38/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.38/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.47/conv/_input_quantizer/QuantizeLinear_clone_3 into /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.42/conv/_input_quantizer/DequantizeLinear_clone_0 and /model.42/conv/_weight_quantizer/DequantizeLinear) into /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.47/conv/_input_quantizer/QuantizeLinear_clone_3 [04/18/2023-18:31:22] [V] [TRT] Removing /model.42/conv/_input_quantizer/DequantizeLinear_clone_0 [04/18/2023-18:31:22] [V] [TRT] Removing /model.42/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.45/conv/_input_quantizer/QuantizeLinear into /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.44/conv/_input_quantizer/DequantizeLinear and /model.44/conv/_weight_quantizer/DequantizeLinear) into /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.45/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.44/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.44/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.47/conv/_input_quantizer/QuantizeLinear_clone_0 into /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.45/conv/_input_quantizer/DequantizeLinear and /model.45/conv/_weight_quantizer/DequantizeLinear) into /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.47/conv/_input_quantizer/QuantizeLinear_clone_0 [04/18/2023-18:31:22] [V] [TRT] Removing /model.45/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.45/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.47/conv/_input_quantizer/DequantizeLinear and /model.47/conv/_weight_quantizer/DequantizeLinear) into /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.47/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.47/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.52/conv/_input_quantizer/QuantizeLinear_clone_1 into /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.48/conv/_input_quantizer/DequantizeLinear and /model.48/conv/_weight_quantizer/DequantizeLinear) into /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.52/conv/_input_quantizer/QuantizeLinear_clone_1 [04/18/2023-18:31:22] [V] [TRT] Removing /model.48/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.48/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.57/conv/_input_quantizer/QuantizeLinear_clone_3 into /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.52/conv/_input_quantizer/DequantizeLinear_clone_0 and /model.52/conv/_weight_quantizer/DequantizeLinear) into /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.57/conv/_input_quantizer/QuantizeLinear_clone_3 [04/18/2023-18:31:22] [V] [TRT] Removing /model.52/conv/_input_quantizer/DequantizeLinear_clone_0 [04/18/2023-18:31:22] [V] [TRT] Removing /model.52/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.55/conv/_input_quantizer/QuantizeLinear into /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.54/conv/_input_quantizer/DequantizeLinear and /model.54/conv/_weight_quantizer/DequantizeLinear) into /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.55/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.54/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.54/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.57/conv/_input_quantizer/QuantizeLinear_clone_0 into /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.55/conv/_input_quantizer/DequantizeLinear and /model.55/conv/_weight_quantizer/DequantizeLinear) into /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.57/conv/_input_quantizer/QuantizeLinear_clone_0 [04/18/2023-18:31:22] [V] [TRT] Removing /model.55/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.55/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.58/conv/_input_quantizer/QuantizeLinear into /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.57/conv/_input_quantizer/DequantizeLinear and /model.57/conv/_weight_quantizer/DequantizeLinear) into /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.58/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.57/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.57/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.58/conv/_input_quantizer/DequantizeLinear and /model.58/conv/_weight_quantizer/DequantizeLinear) into /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.58/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.58/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.77/m.0/Conv [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.77/m.0/_input_quantizer/DequantizeLinear and /model.77/m.0/_weight_quantizer/DequantizeLinear) into /model.77/m.0/Conv [04/18/2023-18:31:22] [V] [TRT] Removing /model.77/m.0/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.77/m.0/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.62/conv/_input_quantizer/QuantizeLinear into /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.61/conv/_input_quantizer/DequantizeLinear and /model.61/conv/_weight_quantizer/DequantizeLinear) into /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.62/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.61/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.61/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.63/conv/_input_quantizer/QuantizeLinear into /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.62/conv/_input_quantizer/DequantizeLinear and /model.62/conv/_weight_quantizer/DequantizeLinear) into /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.63/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.62/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.62/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.65/conv/_input_quantizer/QuantizeLinear_clone_0 into /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.63/conv/_input_quantizer/DequantizeLinear and /model.63/conv/_weight_quantizer/DequantizeLinear) into /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.65/conv/_input_quantizer/QuantizeLinear_clone_0 [04/18/2023-18:31:22] [V] [TRT] Removing /model.63/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.63/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.66/conv/_input_quantizer/QuantizeLinear into /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.65/conv/_input_quantizer/DequantizeLinear and /model.65/conv/_weight_quantizer/DequantizeLinear) into /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.66/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.65/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.65/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.66/conv/_input_quantizer/DequantizeLinear and /model.66/conv/_weight_quantizer/DequantizeLinear) into /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.66/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.66/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.77/m.1/Conv [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.77/m.1/_input_quantizer/DequantizeLinear and /model.77/m.1/_weight_quantizer/DequantizeLinear) into /model.77/m.1/Conv [04/18/2023-18:31:22] [V] [TRT] Removing /model.77/m.1/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.77/m.1/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.70/conv/_input_quantizer/QuantizeLinear into /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.69/conv/_input_quantizer/DequantizeLinear and /model.69/conv/_weight_quantizer/DequantizeLinear) into /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.70/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.69/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.69/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.71/conv/_input_quantizer/QuantizeLinear into /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.70/conv/_input_quantizer/DequantizeLinear and /model.70/conv/_weight_quantizer/DequantizeLinear) into /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.71/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.70/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.70/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.73/conv/_input_quantizer/QuantizeLinear_clone_0 into /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.71/conv/_input_quantizer/DequantizeLinear and /model.71/conv/_weight_quantizer/DequantizeLinear) into /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.73/conv/_input_quantizer/QuantizeLinear_clone_0 [04/18/2023-18:31:22] [V] [TRT] Removing /model.71/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.71/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.76/conv/_input_quantizer/QuantizeLinear into /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.73/conv/_input_quantizer/DequantizeLinear and /model.73/conv/_weight_quantizer/DequantizeLinear) into /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.76/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.73/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.73/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.77/m.2/_input_quantizer/QuantizeLinear into /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.76/conv/_input_quantizer/DequantizeLinear and /model.76/conv/_weight_quantizer/DequantizeLinear) into /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.77/m.2/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.76/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.76/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.77/m.2/Conv [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.77/m.2/_input_quantizer/DequantizeLinear and /model.77/m.2/_weight_quantizer/DequantizeLinear) into /model.77/m.2/Conv [04/18/2023-18:31:22] [V] [TRT] Removing /model.77/m.2/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.77/m.2/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.4/conv/_input_quantizer/QuantizeLinear into /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.3/conv/_input_quantizer/DequantizeLinear and /model.3/conv/_weight_quantizer/DequantizeLinear) into /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.4/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.3/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.3/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.11/conv/_input_quantizer/QuantizeLinear into /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.9/conv/_input_quantizer/DequantizeLinear_clone_1 and /model.10/conv/_weight_quantizer/DequantizeLinear) into /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.11/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.9/conv/_input_quantizer/DequantizeLinear_clone_1 [04/18/2023-18:31:22] [V] [TRT] Removing /model.10/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.21/conv/_input_quantizer/QuantizeLinear_clone_3 into /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.16/conv/_input_quantizer/DequantizeLinear and /model.16/conv/_weight_quantizer/DequantizeLinear) into /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.21/conv/_input_quantizer/QuantizeLinear_clone_3 [04/18/2023-18:31:22] [V] [TRT] Removing /model.16/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.16/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.28/conv/_input_quantizer/QuantizeLinear_clone_3 into /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.23/conv/_input_quantizer/DequantizeLinear and /model.23/conv/_weight_quantizer/DequantizeLinear) into /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.28/conv/_input_quantizer/QuantizeLinear_clone_3 [04/18/2023-18:31:22] [V] [TRT] Removing /model.23/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.23/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.35/conv/_input_quantizer/QuantizeLinear_clone_2 into /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.30/conv/_input_quantizer/DequantizeLinear and /model.30/conv/_weight_quantizer/DequantizeLinear) into /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.35/conv/_input_quantizer/QuantizeLinear_clone_2 [04/18/2023-18:31:22] [V] [TRT] Removing /model.30/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.30/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.44/conv/_input_quantizer/QuantizeLinear into /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.42/conv/_input_quantizer/DequantizeLinear_clone_1 and /model.43/conv/_weight_quantizer/DequantizeLinear) into /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.44/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.42/conv/_input_quantizer/DequantizeLinear_clone_1 [04/18/2023-18:31:22] [V] [TRT] Removing /model.43/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.54/conv/_input_quantizer/QuantizeLinear into /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.52/conv/_input_quantizer/DequantizeLinear_clone_1 and /model.53/conv/_weight_quantizer/DequantizeLinear) into /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.54/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.52/conv/_input_quantizer/DequantizeLinear_clone_1 [04/18/2023-18:31:22] [V] [TRT] Removing /model.53/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.77/m.0/_input_quantizer/QuantizeLinear into /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.74/conv/_input_quantizer/DequantizeLinear and /model.74/conv/_weight_quantizer/DequantizeLinear) into /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.77/m.0/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.74/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.74/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.65/conv/_input_quantizer/QuantizeLinear_clone_3 into /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.60/conv/_input_quantizer/DequantizeLinear and /model.60/conv/_weight_quantizer/DequantizeLinear) into /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.65/conv/_input_quantizer/QuantizeLinear_clone_3 [04/18/2023-18:31:22] [V] [TRT] Removing /model.60/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.60/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.77/m.1/_input_quantizer/QuantizeLinear into /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.75/conv/_input_quantizer/DequantizeLinear and /model.75/conv/_weight_quantizer/DequantizeLinear) into /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.77/m.1/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.75/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.75/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeDoubleInputNodes on /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing /model.73/conv/_input_quantizer/QuantizeLinear_clone_3 into /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeDoubleInputNodes: fusing (/model.68/conv/_input_quantizer/DequantizeLinear and /model.68/conv/_weight_quantizer/DequantizeLinear) into /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.73/conv/_input_quantizer/QuantizeLinear_clone_3 [04/18/2023-18:31:22] [V] [TRT] Removing /model.68/conv/_input_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Removing /model.68/conv/_weight_quantizer/DequantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: QuantizeGenericNodes on PWN(/model.0/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] QuantizeGenericNodes: fusing /model.1/conv/_input_quantizer/QuantizeLinear into PWN(/model.0/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Removing /model.1/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear with /model.0/conv/Conv [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear with /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear with /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear with /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear with /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear with /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear with /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear with /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear with /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear with /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear with /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear with /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear with /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear with /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear with /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear with /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear with /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear with /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear with /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear with /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear with /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear with /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear with /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear with /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear with /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear with /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear with /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear with /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear with /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear with /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear with /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear with /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear with /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear with /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear with /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear with /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear with /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear with /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear with /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear with /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear with /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear with /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear with /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear with /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear with /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear with /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear with /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear with /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear with /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear with /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear with /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear with /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear with /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear with /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear with /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear with /model.77/m.0/Conv [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear with /model.77/m.1/Conv [04/18/2023-18:31:22] [V] [TRT] Running: ConstWeightsFusion on model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] ConstWeightsFusion: Fusing model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear with /model.77/m.2/Conv [04/18/2023-18:31:22] [V] [TRT] After dupe layer removal: 128 layers [04/18/2023-18:31:22] [V] [TRT] After final dead-layer removal: 128 layers [04/18/2023-18:31:22] [V] [TRT] After tensor merging: 128 layers [04/18/2023-18:31:22] [V] [TRT] QDQ graph optimizer quantization epilogue pass [04/18/2023-18:31:22] [V] [TRT] QDQ optimization pass [04/18/2023-18:31:22] [V] [TRT] QDQ graph optimizer constant fold dangling QDQ pass [04/18/2023-18:31:22] [V] [TRT] Running: QDQToCopy on /model.0/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Swap the layer type of /model.0/conv/_input_quantizer/QuantizeLinear from QUANTIZE to kQDQ [04/18/2023-18:31:22] [V] [TRT] Running: QDQToCopy on /model.50/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Swap the layer type of /model.50/conv/_input_quantizer/QuantizeLinear from QUANTIZE to kQDQ [04/18/2023-18:31:22] [V] [TRT] Running: QDQToCopy on /model.16/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Swap the layer type of /model.16/conv/_input_quantizer/QuantizeLinear from QUANTIZE to kQDQ [04/18/2023-18:31:22] [V] [TRT] Running: QDQToCopy on /model.17/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Swap the layer type of /model.17/conv/_input_quantizer/QuantizeLinear from QUANTIZE to kQDQ [04/18/2023-18:31:22] [V] [TRT] Running: QDQToCopy on /model.40/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Swap the layer type of /model.40/conv/_input_quantizer/QuantizeLinear from QUANTIZE to kQDQ [04/18/2023-18:31:22] [V] [TRT] Running: QDQToCopy on /model.23/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Swap the layer type of /model.23/conv/_input_quantizer/QuantizeLinear from QUANTIZE to kQDQ [04/18/2023-18:31:22] [V] [TRT] Running: QDQToCopy on /model.24/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Swap the layer type of /model.24/conv/_input_quantizer/QuantizeLinear from QUANTIZE to kQDQ [04/18/2023-18:31:22] [V] [TRT] Running: QDQToCopy on /model.38/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Swap the layer type of /model.38/conv/_input_quantizer/QuantizeLinear from QUANTIZE to kQDQ [04/18/2023-18:31:22] [V] [TRT] Running: QDQToCopy on /model.48/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Swap the layer type of /model.48/conv/_input_quantizer/QuantizeLinear from QUANTIZE to kQDQ [04/18/2023-18:31:22] [V] [TRT] Running: QDQToCopy on /model.60/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Swap the layer type of /model.60/conv/_input_quantizer/QuantizeLinear from QUANTIZE to kQDQ [04/18/2023-18:31:22] [V] [TRT] Running: QDQToCopy on /model.61/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Swap the layer type of /model.61/conv/_input_quantizer/QuantizeLinear from QUANTIZE to kQDQ [04/18/2023-18:31:22] [V] [TRT] Running: QDQToCopy on /model.68/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Swap the layer type of /model.68/conv/_input_quantizer/QuantizeLinear from QUANTIZE to kQDQ [04/18/2023-18:31:22] [V] [TRT] Running: QDQToCopy on /model.69/conv/_input_quantizer/QuantizeLinear [04/18/2023-18:31:22] [V] [TRT] Swap the layer type of /model.69/conv/_input_quantizer/QuantizeLinear from QUANTIZE to kQDQ [04/18/2023-18:31:22] [V] [TRT] After dupe layer removal: 128 layers [04/18/2023-18:31:22] [V] [TRT] After final dead-layer removal: 128 layers [04/18/2023-18:31:22] [V] [TRT] After tensor merging: 128 layers [04/18/2023-18:31:22] [V] [TRT] After vertical fusions: 128 layers [04/18/2023-18:31:22] [V] [TRT] After dupe layer removal: 128 layers [04/18/2023-18:31:22] [V] [TRT] After final dead-layer removal: 128 layers [04/18/2023-18:31:22] [V] [TRT] After tensor merging: 128 layers [04/18/2023-18:31:22] [V] [TRT] After slice removal: 128 layers [04/18/2023-18:31:22] [V] [TRT] Eliminating concatenation /model.77/Concat_3 [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.77/Reshape_1_output_0 to outputs [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.77/Reshape_3_output_0 to outputs [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.77/Reshape_5_output_0 to outputs [04/18/2023-18:31:22] [V] [TRT] Eliminating concatenation /model.77/Concat_2 [04/18/2023-18:31:22] [V] [TRT] Generating copy for /model.77/Add_2_output_0 to /model.77/Concat_2_output_0 because of stomping hazard. [04/18/2023-18:31:22] [V] [TRT] Generating copy for /model.77/Mul_5_output_0 to /model.77/Concat_2_output_0 because of stomping hazard. [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.77/Split_2_output_2 to /model.77/Concat_2_output_0 [04/18/2023-18:31:22] [V] [TRT] Eliminating concatenation /model.72/Concat [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.72/Concat_/model.71/act/LeakyRelu_output_0_clone_0 to /model.73/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:22] [V] [TRT] Generating copy for /model.71/conv/_input_quantizer/QuantizeLinear_output_0 to /model.73/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-18:31:22] [V] [TRT] Generating copy for /model.70/conv/_input_quantizer/QuantizeLinear_output_0 to /model.73/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3 to /model.73/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:22] [V] [TRT] Eliminating concatenation /model.77/Concat_1 [04/18/2023-18:31:22] [V] [TRT] Generating copy for /model.77/Add_1_output_0 to /model.77/Concat_1_output_0 because of stomping hazard. [04/18/2023-18:31:22] [V] [TRT] Generating copy for /model.77/Mul_3_output_0 to /model.77/Concat_1_output_0 because of stomping hazard. [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.77/Split_1_output_2 to /model.77/Concat_1_output_0 [04/18/2023-18:31:22] [V] [TRT] Eliminating concatenation /model.67/Concat [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.66/act/LeakyRelu_output_0 to /model.67/Concat_output_0 [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.37/act/LeakyRelu_output_0 to /model.67/Concat_output_0 [04/18/2023-18:31:22] [V] [TRT] Eliminating concatenation /model.64/Concat [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.64/Concat_/model.63/act/LeakyRelu_output_0_clone_0 to /model.65/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:22] [V] [TRT] Generating copy for /model.63/conv/_input_quantizer/QuantizeLinear_output_0 to /model.65/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-18:31:22] [V] [TRT] Generating copy for /model.62/conv/_input_quantizer/QuantizeLinear_output_0 to /model.65/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.64/Concat_/model.60/act/LeakyRelu_output_0_clone_3 to /model.65/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:22] [V] [TRT] Eliminating concatenation /model.77/Concat [04/18/2023-18:31:22] [V] [TRT] Generating copy for /model.77/Add_output_0 to /model.77/Concat_output_0 because of stomping hazard. [04/18/2023-18:31:22] [V] [TRT] Generating copy for /model.77/Mul_1_output_0 to /model.77/Concat_output_0 because of stomping hazard. [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.77/Split_output_2 to /model.77/Concat_output_0 [04/18/2023-18:31:22] [V] [TRT] Eliminating concatenation /model.59/Concat [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.58/act/LeakyRelu_output_0 to /model.59/Concat_output_0 [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.47/act/LeakyRelu_output_0 to /model.59/Concat_output_0 [04/18/2023-18:31:22] [V] [TRT] Eliminating concatenation /model.56/Concat [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.56/Concat_/model.55/act/LeakyRelu_output_0_clone_0 to /model.57/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:22] [V] [TRT] Generating copy for /model.55/conv/_input_quantizer/QuantizeLinear_output_0 to /model.57/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-18:31:22] [V] [TRT] Generating copy for /model.54/conv/_input_quantizer/QuantizeLinear_output_0 to /model.57/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3 to /model.57/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:22] [V] [TRT] Eliminating concatenation /model.51/Concat [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0 to /model.52/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:22] [V] [TRT] Generating copy for /model.51/Concat_/model.49/Resize_output_0_clone_1 to /model.52/conv/_input_quantizer/QuantizeLinear_output_0 because input does not support striding. [04/18/2023-18:31:22] [V] [TRT] Eliminating concatenation /model.46/Concat [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.46/Concat_/model.45/act/LeakyRelu_output_0_clone_0 to /model.47/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:22] [V] [TRT] Generating copy for /model.45/conv/_input_quantizer/QuantizeLinear_output_0 to /model.47/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-18:31:22] [V] [TRT] Generating copy for /model.44/conv/_input_quantizer/QuantizeLinear_output_0 to /model.47/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3 to /model.47/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:22] [V] [TRT] Eliminating concatenation /model.41/Concat [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0 to /model.42/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:22] [V] [TRT] Generating copy for /model.41/Concat_/model.39/Resize_output_0_clone_1 to /model.42/conv/_input_quantizer/QuantizeLinear_output_0 because input does not support striding. [04/18/2023-18:31:22] [V] [TRT] Eliminating concatenation /model.36/Concat [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.36/Concat_/model.35/act/LeakyRelu_output_0_clone_0 to /model.37/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1 to /model.37/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:22] [V] [TRT] Eliminating concatenation /model.34/Concat [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.34/Concat_/model.33/m/MaxPool_output_0_clone_0 to /model.35/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.34/Concat_/model.32/m/MaxPool_output_0_clone_1 to /model.35/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.34/Concat_/model.31/m/MaxPool_output_0_clone_2 to /model.35/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:22] [V] [TRT] Generating copy for /model.31/m/MaxPool_output_0 to /model.35/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-18:31:22] [V] [TRT] Eliminating concatenation /model.27/Concat [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.27/Concat_/model.26/act/LeakyRelu_output_0_clone_0 to /model.28/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:22] [V] [TRT] Generating copy for /model.26/conv/_input_quantizer/QuantizeLinear_output_0 to /model.28/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-18:31:22] [V] [TRT] Generating copy for /model.25/conv/_input_quantizer/QuantizeLinear_output_0 to /model.28/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3 to /model.28/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:22] [V] [TRT] Eliminating concatenation /model.20/Concat [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.20/Concat_/model.19/act/LeakyRelu_output_0_clone_0 to /model.21/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:22] [V] [TRT] Generating copy for /model.19/conv/_input_quantizer/QuantizeLinear_output_0 to /model.21/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-18:31:22] [V] [TRT] Generating copy for /model.18/conv/_input_quantizer/QuantizeLinear_output_0 to /model.21/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3 to /model.21/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:22] [V] [TRT] Eliminating concatenation /model.13/Concat [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.13/Concat_/model.12/act/LeakyRelu_output_0_clone_0 to /model.14/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:22] [V] [TRT] Generating copy for /model.12/conv/_input_quantizer/QuantizeLinear_output_0 to /model.14/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-18:31:22] [V] [TRT] Generating copy for /model.11/conv/_input_quantizer/QuantizeLinear_output_0 to /model.14/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3 to /model.14/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:22] [V] [TRT] Eliminating concatenation /model.6/Concat [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.6/Concat_/model.5/act/LeakyRelu_output_0_clone_0 to /model.7/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:22] [V] [TRT] Generating copy for /model.5/conv/_input_quantizer/QuantizeLinear_output_0 to /model.7/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-18:31:22] [V] [TRT] Generating copy for /model.4/conv/_input_quantizer/QuantizeLinear_output_0 to /model.7/conv/_input_quantizer/QuantizeLinear_output_0 because concat input is consumed by producer of another input. [04/18/2023-18:31:22] [V] [TRT] Retargeting /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3 to /model.7/conv/_input_quantizer/QuantizeLinear_output_0 [04/18/2023-18:31:22] [V] [TRT] After concat removal: 135 layers [04/18/2023-18:31:22] [V] [TRT] Trying to split Reshape and strided tensor [04/18/2023-18:31:22] [V] [TRT] Generating copy after /model.77/Reshape_1 [04/18/2023-18:31:22] [V] [TRT] Generating copy after /model.77/Reshape_3 [04/18/2023-18:31:22] [V] [TRT] Generating copy after /model.77/Reshape_5 [04/18/2023-18:31:22] [V] [TRT] Graph construction and optimization completed in 2.16924 seconds. [04/18/2023-18:31:22] [V] [TRT] Trying to load shared library libcublas.so.11 [04/18/2023-18:31:22] [V] [TRT] Loaded shared library libcublas.so.11 [04/18/2023-18:31:22] [V] [TRT] Using cublas as plugin tactic source [04/18/2023-18:31:22] [V] [TRT] Trying to load shared library libcublasLt.so.11 [04/18/2023-18:31:22] [V] [TRT] Loaded shared library libcublasLt.so.11 [04/18/2023-18:31:22] [V] [TRT] Using cublasLt as core library tactic source [04/18/2023-18:31:22] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +6, GPU +10, now: CPU 579, GPU 1495 (MiB) [04/18/2023-18:31:22] [V] [TRT] Trying to load shared library libcudnn.so.8 [04/18/2023-18:31:22] [V] [TRT] Loaded shared library libcudnn.so.8 [04/18/2023-18:31:22] [V] [TRT] Using cuDNN as plugin tactic source [04/18/2023-18:31:22] [V] [TRT] Using cuDNN as core library tactic source [04/18/2023-18:31:22] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +2, GPU +10, now: CPU 581, GPU 1505 (MiB) [04/18/2023-18:31:22] [I] [TRT] Local timing cache in use. Profiling results in this builder pass will not be stored. [04/18/2023-18:31:22] [V] [TRT] Constructing optimization profile number 0 [1/1]. [04/18/2023-18:31:22] [V] [TRT] Reserving memory for host IO tensors. Host: 0 bytes [04/18/2023-18:31:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:22] [V] [TRT] *************** Autotuning Reformat: Float(1228800,409600,640,1) -> Int8(409600,409600:4,640,1) *************** [04/18/2023-18:31:22] [V] [TRT] --------------- Timing Runner: /model.0/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0216085 [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0147758 [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00914314 [04/18/2023-18:31:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00914314 [04/18/2023-18:31:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:22] [V] [TRT] *************** Autotuning Reformat: Float(1228800,409600,640,1) -> Int8(409600,409600:32,640,1) *************** [04/18/2023-18:31:22] [V] [TRT] --------------- Timing Runner: /model.0/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.03931 [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0674377 [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.0455 [04/18/2023-18:31:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0674377 [04/18/2023-18:31:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,409600:4,640,1) -> Int8(409600,409600:32,640,1) *************** [04/18/2023-18:31:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 1.02356 [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.103863 [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.034912 [04/18/2023-18:31:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.034912 [04/18/2023-18:31:22] [V] [TRT] *************** Autotuning Reformat: Int8(409600,409600:32,640,1) -> Int8(409600,409600:4,640,1) *************** [04/18/2023-18:31:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0705097 [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0514408 [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0241912 [04/18/2023-18:31:22] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0241912 [04/18/2023-18:31:22] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:22] [V] [TRT] *************** Autotuning Reformat: Float(3276800,102400,320,1) -> Float(102400,102400:32,320,1) *************** [04/18/2023-18:31:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.282304 [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0541135 [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.331232 [04/18/2023-18:31:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0541135 [04/18/2023-18:31:22] [V] [TRT] *************** Autotuning Reformat: Float(3276800,102400,320,1) -> Half(3276800,102400,320,1) *************** [04/18/2023-18:31:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0332288 [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0330587 [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0467337 [04/18/2023-18:31:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0330587 [04/18/2023-18:31:22] [V] [TRT] *************** Autotuning Reformat: Float(3276800,102400,320,1) -> Half(102400,102400:32,320,1) *************** [04/18/2023-18:31:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.168987 [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0335013 [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.169838 [04/18/2023-18:31:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0335013 [04/18/2023-18:31:22] [V] [TRT] *************** Autotuning Reformat: Float(102400,102400:32,320,1) -> Float(3276800,102400,320,1) *************** [04/18/2023-18:31:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.172032 [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0538743 [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.172229 [04/18/2023-18:31:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0538743 [04/18/2023-18:31:22] [V] [TRT] *************** Autotuning Reformat: Float(102400,102400:32,320,1) -> Half(3276800,102400,320,1) *************** [04/18/2023-18:31:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.163547 [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0340882 [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.162277 [04/18/2023-18:31:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0340882 [04/18/2023-18:31:22] [V] [TRT] *************** Autotuning Reformat: Float(102400,102400:32,320,1) -> Half(102400,102400:32,320,1) *************** [04/18/2023-18:31:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.35723 [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0337024 [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.361472 [04/18/2023-18:31:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0337024 [04/18/2023-18:31:22] [V] [TRT] *************** Autotuning Reformat: Half(3276800,102400,320,1) -> Float(3276800,102400,320,1) *************** [04/18/2023-18:31:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0318217 [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0334702 [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.044288 [04/18/2023-18:31:22] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0318217 [04/18/2023-18:31:22] [V] [TRT] *************** Autotuning Reformat: Half(3276800,102400,320,1) -> Float(102400,102400:32,320,1) *************** [04/18/2023-18:31:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.263314 [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0337042 [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.264631 [04/18/2023-18:31:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0337042 [04/18/2023-18:31:22] [V] [TRT] *************** Autotuning Reformat: Half(3276800,102400,320,1) -> Half(102400,102400:32,320,1) *************** [04/18/2023-18:31:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.156379 [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0226632 [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.155941 [04/18/2023-18:31:22] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0226632 [04/18/2023-18:31:22] [V] [TRT] *************** Autotuning Reformat: Half(102400,102400:32,320,1) -> Float(3276800,102400,320,1) *************** [04/18/2023-18:31:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:22] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.130779 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0338715 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.125419 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0338715 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Half(102400,102400:32,320,1) -> Float(102400,102400:32,320,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.419109 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0347337 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.421595 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0347337 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Half(102400,102400:32,320,1) -> Half(3276800,102400,320,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.0/conv/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.101973 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0770926 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.103424 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0770926 [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(3276800,102400,320,1) -> Int8(819200,102400:4,320,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.1/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0496274 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0363154 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0496396 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0363154 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(3276800,102400,320,1) -> Int8(102400,102400:32,320,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.1/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0848457 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0302574 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0878697 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0302574 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,102400:4,320,1) -> Int8(3276800,102400,320,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.1/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0491124 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0463726 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0440297 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0440297 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,102400:4,320,1) -> Int8(102400,102400:32,320,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.1/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0565013 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0419509 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0119806 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0119806 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,102400:32,320,1) -> Int8(3276800,102400,320,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.1/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0502598 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0659749 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0496396 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0496396 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,102400:32,320,1) -> Int8(819200,102400:4,320,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.1/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0175741 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0308462 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00964632 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00964632 [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,25600,160,1) -> Int8(409600,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.2/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0226057 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120472 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00710182 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00710182 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,25600,160,1) -> Int8(51200,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.2/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0397897 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0123718 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0396069 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0123718 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,25600:4,160,1) -> Int8(1638400,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.2/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0226815 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0135697 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0226403 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0135697 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,25600:4,160,1) -> Int8(51200,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.2/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0317714 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0134674 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00592256 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00592256 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,25600:32,160,1) -> Int8(1638400,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.2/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0249341 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0348846 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.024877 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.024877 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,25600:32,160,1) -> Int8(409600,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.2/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00998613 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0134151 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00487604 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00487604 [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,25600,160,1) -> Int8(409600,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.2/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0225293 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119467 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00701801 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00701801 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,25600,160,1) -> Int8(51200,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.2/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0395943 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121524 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0396069 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0121524 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,25600:4,160,1) -> Int8(1638400,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.2/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0226338 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0135684 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0226038 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0135684 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,25600:4,160,1) -> Int8(51200,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.2/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0317678 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.013391 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00579127 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00579127 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,25600:32,160,1) -> Int8(1638400,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.2/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0249417 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0348745 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.024912 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.024912 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,25600:32,160,1) -> Int8(409600,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.2/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0100084 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0133789 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00488594 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00488594 [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(3276800,25600,160,1) long-strided -> Int8(819200,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0125185 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00777985 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00477364 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00477364 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(3276800,25600,160,1) long-strided -> Int8(102400,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0212265 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00953935 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0212532 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00953935 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600:4,160,1) long-strided -> Int8(3276800,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.012541 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120827 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0125101 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0120827 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600:4,160,1) long-strided -> Int8(102400,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.01852 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00876639 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00371634 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00371634 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,25600:32,160,1) long-strided -> Int8(3276800,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0140035 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0203337 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.014043 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0140035 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,25600:32,160,1) long-strided -> Int8(819200,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00669299 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00878091 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00407962 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00407962 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00402121 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0128312 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.004024 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00402121 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0125002 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00778033 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00477349 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00477349 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0212676 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00808279 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0212114 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00808279 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.012563 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120705 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0125406 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0120705 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00536025 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00878548 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00672021 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00536025 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0184503 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00881479 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00375783 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00375783 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0140069 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0207327 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0139769 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0139769 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00670005 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00864968 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00403594 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00403594 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.6/Concat_/model.2/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0199897 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00827606 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00545311 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00545311 [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,25600,160,1) -> Int8(409600,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,25600,160,1) -> Int8(51200,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,25600:4,160,1) -> Int8(1638400,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,25600:4,160,1) -> Int8(51200,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,25600:32,160,1) -> Int8(1638400,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,25600:32,160,1) -> Int8(409600,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(204800,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.4/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0125013 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109283 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00475045 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00475045 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.4/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0212584 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109584 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0212323 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0109584 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(819200,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.4/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0124956 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120731 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0125032 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0120731 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.4/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0185514 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106158 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00382184 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00382184 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(819200,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.4/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0139965 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.020368 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0139919 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0139919 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(204800,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.4/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00669984 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108434 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00404203 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00404203 [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(204800,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.4/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.012501 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109091 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00477349 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00477349 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.4/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0212114 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00963048 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0212944 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00963048 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(819200,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.4/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0125806 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120667 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.012515 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0120667 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.4/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0185051 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.008736 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00376529 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00376529 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(819200,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.4/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0139952 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0203629 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0140613 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0139952 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(204800,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.4/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00667491 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00865398 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00402984 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00402984 [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(204800,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(819200,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(819200,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(204800,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(204800,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(819200,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(819200,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(204800,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(3276800,25600,160,1) long-strided -> Int8(819200,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(3276800,25600,160,1) long-strided -> Int8(102400,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600:4,160,1) long-strided -> Int8(3276800,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600:4,160,1) long-strided -> Int8(102400,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,25600:32,160,1) long-strided -> Int8(3276800,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,25600:32,160,1) long-strided -> Int8(819200,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.5/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00399873 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0127756 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00400965 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00399873 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.5/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0125131 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00776638 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00476587 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00476587 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.5/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0212532 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00805613 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0212611 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00805613 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.5/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0125825 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121067 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0124819 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0121067 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.5/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00534349 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00871933 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00672166 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00534349 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.5/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0185051 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00874003 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00372724 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00372724 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.5/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0139994 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0205009 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.013967 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.013967 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.5/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00668426 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00863946 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00405752 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00405752 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.5/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0200034 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00652135 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0035268 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0035268 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.4/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00400127 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012747 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00400838 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00400127 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.4/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0124549 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00776036 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00476328 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00476328 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.4/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0212532 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00805714 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0212147 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00805714 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.4/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0125147 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120682 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.012544 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0120682 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.4/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00536652 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00870185 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00671958 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00536652 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(204800,25600:4,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.4/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0184886 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010578 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0037606 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0037606 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.4/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0140193 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.020623 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0140089 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0140089 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.4/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00668966 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105006 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00402019 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00402019 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(25600,25600:32,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.4/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0201697 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00674431 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00356081 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00356081 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(3276800,25600,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.7/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0442149 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.021393 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0163576 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0163576 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(3276800,25600,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.7/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0773691 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0214674 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0772389 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0214674 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600:4,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.7/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0436674 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0231993 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0436034 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0231993 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(819200,25600:4,160,1) -> Int8(102400,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.7/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0590507 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0248739 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.013386 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.013386 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,25600:32,160,1) -> Int8(3276800,25600,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.7/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0484693 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0649021 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0480533 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0480533 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,25600:32,160,1) -> Int8(819200,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.7/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0173074 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0249425 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00823086 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00823086 [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,25600,160,1) -> Int8(409600,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,25600,160,1) -> Int8(51200,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,25600:4,160,1) -> Int8(51200,25600:32,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,25600:32,160,1) -> Int8(409600,25600:4,160,1) *************** [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.9/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00768553 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00733714 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00764704 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00733714 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.9/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0116972 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060141 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00317058 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00317058 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.9/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0089081 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0129448 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00893943 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0089081 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.9/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00502968 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593609 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00335447 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00335447 [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.9/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0076071 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00638231 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00360354 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00360354 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.9/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0124739 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00655335 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0124861 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00655335 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.9/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0076812 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00720343 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00767134 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00720343 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.9/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.01168 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603848 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0031519 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0031519 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.9/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0089358 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0204591 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00890729 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00890729 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.9/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0050095 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105561 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00339221 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00339221 [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,6400,80,1) long-strided -> Int8(409600,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00762298 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104552 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00360526 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00360526 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,6400,80,1) long-strided -> Int8(51200,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0125166 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104585 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.012475 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0104585 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400:4,80,1) long-strided -> Int8(1638400,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00770406 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102632 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00769251 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00769251 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400:4,80,1) long-strided -> Int8(51200,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0116962 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113871 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0031683 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0031683 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:32,80,1) long-strided -> Int8(1638400,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00890003 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0131736 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00896314 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00890003 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:32,80,1) long-strided -> Int8(409600,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0050106 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103615 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00335096 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00335096 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(1638400,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00357726 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104666 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00376698 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00357726 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00760421 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110325 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00389819 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00389819 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0124994 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108947 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0124884 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0108947 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(1638400,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00776253 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100721 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00764872 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00764872 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00399746 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00651969 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00451486 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00399746 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.011642 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604229 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0032587 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0032587 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(1638400,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00891993 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0129208 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00893143 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00891993 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00511559 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598038 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0033751 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0033751 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.13/Concat_/model.9/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0123954 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606286 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00302714 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00302714 [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.11/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00759555 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00697556 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00362937 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00362937 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.11/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0124728 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00636363 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0124884 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00636363 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,6400,80,1) long-strided -> Int8(409600,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,6400,80,1) long-strided -> Int8(51200,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400:4,80,1) long-strided -> Int8(1638400,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400:4,80,1) long-strided -> Int8(51200,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:32,80,1) long-strided -> Int8(1638400,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:32,80,1) long-strided -> Int8(409600,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(1638400,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(1638400,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(1638400,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(1638400,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.12/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00329714 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00874864 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00356125 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00329714 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.12/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00769828 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630519 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00360057 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00360057 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.12/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0125836 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00636164 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0124636 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00636164 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(1638400,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.12/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0076978 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00744983 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00764752 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00744983 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.12/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00399517 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596629 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00449429 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00399517 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.12/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0116846 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605581 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00326182 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00326182 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(1638400,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.12/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00895657 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0129699 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00894686 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00894686 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.12/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00502495 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596057 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00337882 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00337882 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.12/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0124194 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062879 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00303476 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00303476 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(1638400,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.11/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0032721 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00893543 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00340582 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0032721 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.11/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00765979 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630758 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0036064 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0036064 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.11/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0124983 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629664 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0125032 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00629664 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(1638400,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.11/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00767663 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0072272 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00764006 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0072272 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.11/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00401701 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00714377 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00447629 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00401701 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.11/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.011724 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100343 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00318903 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00318903 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(1638400,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.11/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00890434 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0133365 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00892047 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00890434 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.11/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00504812 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612952 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00336447 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00336447 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: /model.11/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0124339 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613295 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00302638 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00302638 [04/18/2023-18:31:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,6400,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0228735 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121055 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00706025 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00706025 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(1638400,6400,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0407771 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0122872 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0411006 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0122872 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400:4,80,1) -> Int8(51200,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0338661 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0136224 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00802159 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00802159 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:32,80,1) -> Int8(409600,6400:4,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0104738 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0134865 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00494786 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00494786 [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Float(819200,6400,80,1) -> Float(204800,1:4,2560,32) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0169244 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101086 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0169874 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0101086 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Float(819200,6400,80,1) -> Float(25600,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0328786 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100931 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0328375 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0100931 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Float(819200,6400,80,1) -> Half(819200,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00411141 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00905514 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0116322 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00411141 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Float(819200,6400,80,1) -> Half(409600,6400:2,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00993463 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116139 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00618095 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00618095 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Float(819200,6400,80,1) -> Half(102400,1:8,1280,16) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0158139 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0075686 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00719589 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00719589 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Float(819200,6400,80,1) -> Half(25600,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0242941 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00824838 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0241806 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00824838 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Float(819200,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0140019 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0125318 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.014021 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0125318 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Float(204800,1:4,2560,32) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0129516 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00912657 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0129173 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00912657 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Half(819200,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0134026 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00933314 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0133565 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00933314 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Half(409600,6400:2,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0138868 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114817 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0138307 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0114817 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Half(102400,1:8,1280,16) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0118752 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00719977 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0118804 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00719977 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Half(25600,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.032181 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00720686 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0322121 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00720686 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Float(819200,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0130635 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00902229 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0130327 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00902229 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Float(204800,1:4,2560,32) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0120488 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0072016 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.012043 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0072016 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Float(25600,6400:32,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0358034 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00823441 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0358034 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00823441 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Half(819200,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0129398 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.02022 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0129295 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0129295 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Half(409600,6400:2,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0079487 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111451 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00796368 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0079487 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Half(102400,1:8,1280,16) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.14/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0114029 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00722537 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0113825 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00722537 [04/18/2023-18:31:23] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Float(819200,6400,80,1) -> Float(204800,1:4,2560,32) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0169976 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100821 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0169107 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0100821 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Float(819200,6400,80,1) -> Half(819200,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00412003 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00904229 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0116185 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00412003 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Float(819200,6400,80,1) -> Half(409600,6400:2,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00992701 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011584 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00616057 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00616057 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Float(819200,6400,80,1) -> Half(102400,1:8,1280,16) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0158007 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00761407 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00720046 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00720046 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Float(204800,1:4,2560,32) -> Float(819200,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0139636 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120107 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0139005 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0120107 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Float(204800,1:4,2560,32) -> Half(819200,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0132584 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00878333 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0132434 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00878333 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Float(204800,1:4,2560,32) -> Half(409600,6400:2,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0139013 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114314 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0138863 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0114314 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Float(204800,1:4,2560,32) -> Half(102400,1:8,1280,16) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0118892 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00718469 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0118818 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00718469 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Float(819200,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0140035 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0124701 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0139961 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0124701 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Float(204800,1:4,2560,32) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0129421 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00909086 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0129573 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00909086 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Half(819200,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0134533 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.009438 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0134375 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.009438 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Half(409600,6400:2,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0139815 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114187 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0140276 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0114187 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Half(102400,1:8,1280,16) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0118579 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00716023 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0119261 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00716023 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400,80,1) -> Float(819200,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00414628 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00929629 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0111061 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00414628 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400,80,1) -> Float(204800,1:4,2560,32) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0159253 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00763837 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0159126 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00763837 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400,80,1) -> Half(409600,6400:2,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00951543 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00783735 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00621575 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00621575 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400,80,1) -> Half(102400,1:8,1280,16) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0151721 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00702955 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00675657 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00675657 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Half(409600,6400:2,80,1) -> Float(819200,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0101406 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.009476 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00619486 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00619486 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Half(409600,6400:2,80,1) -> Float(204800,1:4,2560,32) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0124198 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00788956 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0124217 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00788956 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Half(409600,6400:2,80,1) -> Half(819200,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00948286 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0236323 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00615009 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00615009 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Half(409600,6400:2,80,1) -> Half(102400,1:8,1280,16) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0116744 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00782653 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00509368 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00509368 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:8,1280,16) -> Float(819200,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0130252 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00909057 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00574811 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00574811 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:8,1280,16) -> Float(204800,1:4,2560,32) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0120183 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00719612 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0120865 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00719612 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:8,1280,16) -> Half(819200,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0127707 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0203869 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00528408 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00528408 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:8,1280,16) -> Half(409600,6400:2,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0134508 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011226 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00484008 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00484008 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Float(819200,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0130311 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00903514 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0130252 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00903514 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Float(204800,1:4,2560,32) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0120629 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00718994 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.012059 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00718994 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Half(819200,6400,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0129143 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0202469 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0129295 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0129143 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Half(409600,6400:2,80,1) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00795911 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011156 [04/18/2023-18:31:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00795454 [04/18/2023-18:31:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00795454 [04/18/2023-18:31:23] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Half(102400,1:8,1280,16) *************** [04/18/2023-18:31:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.14/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0113516 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00729051 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.011412 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00729051 [04/18/2023-18:31:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Float(51200,1:4,1280,32) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00556079 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614724 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00557257 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00556079 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00263821 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00632089 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00451043 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00263821 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0041711 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601295 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00313828 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00313828 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Half(25600,1:8,640,16) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00544931 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609962 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00301876 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00301876 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(51200,1:4,1280,32) -> Float(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00550752 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00782532 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00551525 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00550752 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(51200,1:4,1280,32) -> Half(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00552211 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00752289 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00552668 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00552211 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(51200,1:4,1280,32) -> Half(102400,1600:2,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00555815 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599734 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0055636 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00555815 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(51200,1:4,1280,32) -> Half(25600,1:8,640,16) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00466389 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00706612 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0046633 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0046633 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00255453 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00631473 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00424215 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00255453 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600,40,1) -> Float(51200,1:4,1280,32) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00544068 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00714628 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00542815 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00542815 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00406019 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062559 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00314047 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00314047 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600,40,1) -> Half(25600,1:8,640,16) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00524277 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00636522 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00299628 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00299628 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(102400,1600:2,40,1) -> Float(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00421741 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619505 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00313749 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00313749 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(102400,1600:2,40,1) -> Float(51200,1:4,1280,32) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00486156 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115626 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00484511 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00484511 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(102400,1600:2,40,1) -> Half(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00435976 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104993 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00379356 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00379356 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(102400,1600:2,40,1) -> Half(25600,1:8,640,16) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00483718 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605848 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00262458 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00262458 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:8,640,16) -> Float(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00540597 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00704588 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00284056 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00284056 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:8,640,16) -> Float(51200,1:4,1280,32) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00469029 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00761239 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0046863 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0046863 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:8,640,16) -> Half(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00531031 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00837638 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00263547 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00263547 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:8,640,16) -> Half(102400,1600:2,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.15/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00536567 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600495 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00257543 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00257543 [04/18/2023-18:31:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(819200,6400,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00523494 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00839619 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00524571 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00523494 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(819200,6400,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0111771 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00723977 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00383687 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00383687 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(819200,6400,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0210488 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00714384 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0214629 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00714384 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(204800,1:4,2560,32) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0134874 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00880269 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0134737 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00880269 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(204800,1:4,2560,32) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0140812 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00850339 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0146043 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00850339 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(204800,1:4,2560,32) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0291813 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00858407 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.029184 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00858407 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0135015 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00869539 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0136004 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00869539 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.014491 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00767398 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0145239 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00767398 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(25600,6400:32,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0288704 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00975116 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0288978 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00975116 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00424363 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00940057 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00421217 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00421217 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0114113 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00920943 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0114096 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00920943 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.021086 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00711118 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0210371 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00711118 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(409600,6400:2,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0115422 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.013686 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0114968 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0114968 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(409600,6400:2,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00719452 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00952991 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00716114 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00716114 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(409600,6400:2,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0120381 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00801701 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0120461 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00801701 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:8,1280,16) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0137662 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0124933 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0137783 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0124933 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:8,1280,16) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0141124 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0082014 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0140904 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0082014 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:8,1280,16) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0289554 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00644353 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0289618 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00644353 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0134192 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0208046 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0133897 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0133897 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0086884 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00821943 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0086841 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00821943 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(25600,6400:32,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.50/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0139075 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00640397 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0138693 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00640397 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00299962 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0998926 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00298695 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00298695 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.004536 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00754983 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00277424 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00277424 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00741166 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00624179 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00744663 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00624179 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(51200,1:4,1280,32) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00552651 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607467 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00552352 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00552352 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(51200,1:4,1280,32) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0060701 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00644134 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00586514 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00586514 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(51200,1:4,1280,32) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00937143 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00644333 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00936686 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00644333 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00282962 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0729966 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00290313 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00282962 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00467126 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610781 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00466522 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00466522 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00765811 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606419 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00767134 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00606419 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(102400,1600:2,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00467908 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00679335 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00468114 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00467908 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(102400,1600:2,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00361794 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588105 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00360903 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00360903 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(102400,1600:2,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00516735 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591872 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00519886 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00516735 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:8,640,16) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00584576 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00647672 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00585801 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00584576 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:8,640,16) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00590427 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598457 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00583186 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00583186 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:8,640,16) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.16/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.009458 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006496 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00951257 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.006496 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00298905 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0999771 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00302714 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00298905 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00452686 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597771 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268224 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00268224 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00744137 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610781 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00737303 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00610781 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(51200,1:4,1280,32) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00550505 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598057 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00554655 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00550505 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(51200,1:4,1280,32) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00585344 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00647235 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00587447 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00585344 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(51200,1:4,1280,32) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00935086 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00645168 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00937772 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00645168 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00290981 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0730766 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283895 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00283895 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00467466 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00622668 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00505427 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00467466 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00770695 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596552 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00764656 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00596552 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(102400,1600:2,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00466876 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00679481 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0046602 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0046602 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(102400,1600:2,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0036392 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591781 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00361577 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00361577 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(102400,1600:2,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00516196 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595562 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00516931 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00516196 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:8,640,16) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00585783 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006464 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00584869 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00584869 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:8,640,16) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00587246 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058933 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00585307 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00585307 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:8,640,16) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.17/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00949743 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588526 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00946514 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00588526 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.50/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0126891 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00784409 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00480914 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00480914 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.50/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0218403 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00817778 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0218299 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00817778 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.50/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0127573 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00901629 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0127554 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00901629 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.50/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.019072 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00889277 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0049152 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0049152 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.50/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0143365 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0204937 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0142875 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0142875 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.50/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00700038 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112116 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00411886 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00411886 [04/18/2023-18:31:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) long-strided -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00759483 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111669 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00362949 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00362949 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) long-strided -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0125074 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01262 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0129055 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0125074 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) long-strided -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00765137 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110611 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00764511 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00764511 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) long-strided -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0117208 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111079 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00406565 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00406565 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) long-strided -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00895714 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0129707 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.008932 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.008932 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) long-strided -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00502542 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111107 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00376012 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00376012 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038418 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111659 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00434078 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0038418 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00762466 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0131441 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00448914 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00448914 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0124587 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112074 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0125109 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0112074 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00765065 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111089 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00764752 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00764752 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00431677 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104216 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00449857 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00431677 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0117366 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111332 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00397346 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00397346 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00892504 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0129162 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00892316 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00892316 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00499121 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0125973 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00370016 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00370016 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.51/Concat_/model.50/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0124255 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111856 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00402984 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00402984 [04/18/2023-18:31:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.16/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00517224 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116986 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00354553 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00354553 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.16/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0080193 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0145344 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00797333 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00797333 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.16/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00521812 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0212654 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0055847 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00521812 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.16/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00776084 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0136266 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346503 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00346503 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.16/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00618114 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106883 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00622012 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00618114 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.16/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00402578 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110062 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00337797 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00337797 [04/18/2023-18:31:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(819200,1600,40,1) long-strided -> Int8(204800,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00517175 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011098 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00331512 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00331512 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(819200,1600,40,1) long-strided -> Int8(25600,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00793311 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102284 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0079105 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0079105 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600:4,40,1) long-strided -> Int8(819200,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00519478 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0134645 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00519216 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00519216 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600:4,40,1) long-strided -> Int8(25600,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0077695 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111402 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00344816 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00344816 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:32,40,1) long-strided -> Int8(819200,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00614933 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103719 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00618228 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00614933 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:32,40,1) long-strided -> Int8(204800,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00413022 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110934 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00332145 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00332145 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(819200,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00349792 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011188 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00364457 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00349792 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00518139 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110811 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00342944 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00342944 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00777576 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114968 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00781329 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00777576 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(819200,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00525486 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110597 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00517747 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00517747 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00380884 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011174 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0038382 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00380884 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00761359 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111919 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00359966 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00359966 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(819200,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00614743 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0136939 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00616914 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00614743 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00415921 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00620133 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283563 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00283563 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.20/Concat_/model.16/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00808864 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609371 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00952357 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00609371 [04/18/2023-18:31:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.18/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00521747 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060182 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00287278 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00287278 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.18/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00796165 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606133 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00798375 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00606133 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.18/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00515282 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618438 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00519673 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00515282 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.18/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00775026 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613124 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00298114 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00298114 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.18/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00621496 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00865183 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00627776 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00621496 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.18/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00397892 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00669456 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334501 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00334501 [04/18/2023-18:31:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(819200,1600,40,1) long-strided -> Int8(204800,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(819200,1600,40,1) long-strided -> Int8(25600,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600:4,40,1) long-strided -> Int8(819200,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600:4,40,1) long-strided -> Int8(25600,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:32,40,1) long-strided -> Int8(819200,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:32,40,1) long-strided -> Int8(204800,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(819200,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(819200,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(819200,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(819200,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.19/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00347875 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111135 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00477684 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00347875 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.19/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00537803 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114085 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334012 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00334012 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.19/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00803556 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0234606 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00801829 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00801829 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(819200,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.19/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00517469 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108774 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0053528 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00517469 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.19/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00385829 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110389 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00351677 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00351677 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.19/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00787729 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110105 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00350751 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00350751 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(819200,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.19/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00615905 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0135505 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00613695 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00613695 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.19/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00403225 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00652842 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00286016 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00286016 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.19/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00826667 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00724114 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00272293 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00272293 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(819200,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.18/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00872076 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00680838 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00300324 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00300324 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.18/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00514335 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058741 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00304866 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00304866 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.18/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0079028 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00624616 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00786454 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00624616 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(819200,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.18/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00515902 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0061739 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00516033 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00515902 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.18/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00332842 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012063 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00339455 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00332842 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.18/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00776517 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592274 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00305303 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00305303 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(819200,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.18/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00615333 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115981 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0061419 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0061419 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.18/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00610889 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589221 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0029056 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0029056 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: /model.18/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00811937 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591506 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0027876 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0027876 [04/18/2023-18:31:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(819200,1600,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0128952 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00801168 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00483688 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00483688 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(819200,1600,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0219429 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00764487 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0219416 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00764487 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600:4,40,1) -> Int8(25600,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0191874 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00893634 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00572745 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00572745 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:32,40,1) -> Int8(204800,1600:4,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00688871 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0148032 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00394119 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00394119 [04/18/2023-18:31:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0102547 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119718 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0102573 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0102547 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.017664 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120579 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0176259 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0120579 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Half(409600,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00317078 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100303 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00674286 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00317078 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00608114 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102942 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00419592 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00419592 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0100099 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00988038 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0046546 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0046546 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0134412 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102217 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0134525 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0102217 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00835505 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00991756 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00838273 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00835505 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0071632 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119232 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00710814 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00710814 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(409600,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00828191 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00686433 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00830527 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00686433 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00854373 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00785299 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00858783 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00785299 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00707396 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00686171 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00708114 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00686171 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.01744 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00583954 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0174136 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00583954 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0080061 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0123379 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00800914 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0080061 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00725349 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0145808 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00718012 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00718012 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0195794 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00983192 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0195583 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00983192 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(409600,1600,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00789895 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0128392 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00790665 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00789895 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00544271 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00774713 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00537075 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00537075 [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.21/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00679834 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00580444 [04/18/2023-18:31:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00676239 [04/18/2023-18:31:24] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00580444 [04/18/2023-18:31:24] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:24] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0102504 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00643319 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0102527 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00643319 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Half(409600,1600,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00308523 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00658348 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00673496 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00308523 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00607257 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00785564 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0042119 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0042119 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00995566 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00739703 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00452386 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00452386 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Float(409600,1600,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00840686 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00741166 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0084316 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00741166 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(409600,1600,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00833905 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00654857 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0083327 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00654857 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00886803 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00780583 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00886454 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00780583 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0070794 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596571 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00708789 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00596571 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00840381 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00742766 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0083873 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00742766 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00707483 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599105 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00708898 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00599105 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(409600,1600,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00832 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00672104 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00831594 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00672104 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00856712 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00786743 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00854158 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00786743 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0070818 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00580041 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00709268 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00580041 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(409600,1600,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00308192 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00675345 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00657247 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00308192 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(409600,1600,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0100358 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590208 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0100462 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00590208 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(409600,1600,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00588544 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608381 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00455171 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00455171 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(409600,1600,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00961859 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115861 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00426608 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00426608 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00619238 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110119 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00410436 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00410436 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0074864 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109747 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00747977 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00747977 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Half(409600,1600,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00586112 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0143022 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00409391 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00409391 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00717692 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114542 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0034909 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0034909 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Float(409600,1600,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00820521 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110495 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00406311 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00406311 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00712795 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011002 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00713361 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00712795 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Half(409600,1600,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00797003 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0128236 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00368774 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00368774 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00821537 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108989 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00343325 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00343325 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00796572 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108114 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00796851 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00796572 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00729349 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113836 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00716549 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00716549 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(409600,1600,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00788884 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0132571 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00791603 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00788884 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00538785 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108849 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00541799 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00538785 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.21/act/LeakyRelu_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00677465 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115186 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00674701 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00674701 [04/18/2023-18:31:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00464634 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109156 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00454343 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00454343 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Half(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033039 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0209796 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00373251 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0033039 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.003824 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113516 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00342302 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00342302 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00443456 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111434 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00350283 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00350283 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Float(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00414929 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109492 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00488594 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00414929 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00426756 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111121 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00433035 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00426756 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00431744 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111138 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00426958 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00426958 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00401803 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110389 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00410619 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00401803 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(102400,400,20,1) -> Float(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00332991 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0209927 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00376205 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00332991 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(102400,400,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00435283 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111279 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0044383 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00435283 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(102400,400,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00477531 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112137 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349681 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00349681 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(102400,400,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0043779 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115379 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349079 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00349079 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Float(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00379296 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110664 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00339561 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00339561 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0042076 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109946 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00428518 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0042076 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Half(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00403187 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113139 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00363429 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00363429 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00427361 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113452 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00326826 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00326826 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Float(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00424403 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109479 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334129 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00334129 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00433302 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109091 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0043961 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00433302 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Half(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00441032 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117823 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00447214 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00441032 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.22/m/MaxPool_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00421929 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112362 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00320284 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00320284 [04/18/2023-18:31:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00402019 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.195584 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00469614 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00402019 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00686781 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115211 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00390042 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00390042 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0119501 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113779 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0119787 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0113779 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0089202 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111923 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.008934 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0089202 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00980663 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107422 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00969569 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00969569 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0173857 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130838 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.017249 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0130838 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00857734 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113839 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0087965 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00857734 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00895343 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107014 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00901943 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00895343 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0158801 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111096 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0158254 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0111096 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(409600,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00387892 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.142482 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00501344 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00387892 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(409600,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00703369 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113016 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00704849 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00703369 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(409600,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.011963 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110277 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0119604 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0110277 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00696359 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00931486 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00704392 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00696359 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00485486 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00643359 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00481768 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00481768 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00738766 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00655501 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00741943 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00655501 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00865076 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00860934 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00876585 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00860934 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0088277 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00631374 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00883576 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00631374 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0157006 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616019 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0158791 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00616019 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00845418 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130489 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00847704 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00845418 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00588379 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612228 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00593317 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00588379 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.40/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00831238 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00860612 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00833245 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00831238 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00707699 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0534598 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0043204 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0043204 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00404711 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110425 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00366547 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00366547 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00524228 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011936 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00529913 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00524228 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00611562 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011404 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00448886 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00448886 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00448571 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012432 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00451729 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00448571 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00648845 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113284 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00676634 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00648845 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(102400,400,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00427455 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0393874 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00387781 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00387781 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00453057 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112812 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00471034 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00453057 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00526955 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108111 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00539344 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00526955 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00418338 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108137 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00419735 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00418338 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00409796 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012717 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00447771 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00409796 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00434203 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0126903 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00573641 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00434203 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00447629 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01143 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.004499 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00447629 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00446886 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109192 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00450086 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00446886 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.23/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00604971 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0131798 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00605333 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00604971 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0040386 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0534735 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00497103 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0040386 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00423892 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114799 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00394168 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00394168 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00540495 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0169224 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00526498 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00526498 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00441323 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113941 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00442764 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00441323 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00448057 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112123 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00455529 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00448057 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00647473 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113175 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00645227 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00645227 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(102400,400,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00416601 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.039424 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00421526 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00416601 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00415438 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116575 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0081334 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00415438 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0052498 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113716 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0052529 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0052498 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00416274 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111859 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00437555 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00416274 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00398489 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109525 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00878926 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00398489 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00431839 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113589 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00449443 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00431839 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00446771 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112907 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00447443 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00446771 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00448186 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0158334 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00445022 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00445022 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.24/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0060779 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010959 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00607524 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00607524 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.40/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0077185 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011207 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00371728 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00371728 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.40/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.012795 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113878 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.012784 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0113878 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.40/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00775001 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112176 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00775074 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00775001 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.40/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0119093 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112851 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00399568 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00399568 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.40/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00956891 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0124754 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00945514 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00945514 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.40/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0051249 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112742 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00373052 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00373052 [04/18/2023-18:31:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) long-strided -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00516751 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112331 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00425022 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00425022 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) long-strided -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00805791 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110952 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00802514 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00802514 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) long-strided -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00517241 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112749 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00515543 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00515543 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) long-strided -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00788259 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114099 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00450814 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00450814 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) long-strided -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00615352 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113973 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00615028 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00615028 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) long-strided -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00436973 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112967 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00354631 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00354631 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00371282 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0133141 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00666251 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00371282 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00517192 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112039 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00352881 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00352881 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00793408 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111606 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00796191 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00793408 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00518612 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0136478 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00522302 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00518612 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00435034 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112007 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00391969 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00391969 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00775555 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111909 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00362583 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00362583 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00612514 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011968 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00615466 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00612514 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00439176 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011271 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00358229 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00358229 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.41/Concat_/model.40/act/LeakyRelu_output_0_clone_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0082014 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110882 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00360046 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00360046 [04/18/2023-18:31:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.23/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00443803 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0132123 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00435851 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00435851 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.23/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00552176 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109541 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00558822 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00552176 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.23/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00432444 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111796 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.004506 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00432444 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.23/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00553231 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111669 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00537414 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00537414 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.23/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00479954 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0123787 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00475547 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00475547 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.23/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00439938 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011532 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00397384 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00397384 [04/18/2023-18:31:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(409600,400,20,1) long-strided -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00432524 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107964 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345556 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00345556 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(409600,400,20,1) long-strided -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00550453 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106792 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00550207 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00550207 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) long-strided -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00431839 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110681 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00461891 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00431839 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) long-strided -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00553864 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111068 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00374857 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00374857 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) long-strided -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0046866 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0218149 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00468173 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00468173 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) long-strided -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00418847 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110534 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00380427 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00380427 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00451271 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0421303 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.004352 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.004352 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00441351 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.018948 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347211 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00347211 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00565187 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110706 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00569073 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00565187 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00426783 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111135 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00451957 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00426783 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00415948 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0152306 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00585106 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00415948 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00594213 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110087 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00365154 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00365154 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00467628 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113315 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00468881 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00467628 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00426474 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0139769 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00384686 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00384686 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.27/Concat_/model.23/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00564923 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112767 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00406349 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00406349 [04/18/2023-18:31:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.25/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00536466 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110491 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00348856 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00348856 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.25/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00552721 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0122171 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00552932 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00552721 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.25/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00432148 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106668 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00449086 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00432148 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.25/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00548233 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111051 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00368059 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00368059 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.25/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00469088 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0133556 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00467288 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00467288 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.25/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00405435 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115014 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00391178 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00391178 [04/18/2023-18:31:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(409600,400,20,1) long-strided -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(409600,400,20,1) long-strided -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) long-strided -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) long-strided -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) long-strided -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) long-strided -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.26/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00413649 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0421269 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00491029 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00413649 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.26/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00423556 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010975 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347048 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00347048 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.26/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00551789 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114321 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00551613 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00551613 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.26/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00426891 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110994 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00776272 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00426891 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.26/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00436377 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111916 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00361303 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00361303 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.26/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00555481 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110477 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00436862 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00436862 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.26/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00468041 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112742 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00578889 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00468041 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.26/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00440326 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011315 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00363463 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00363463 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.26/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00548893 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.013514 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0036304 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0036304 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.25/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00412251 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0420343 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00404648 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00404648 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.25/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00435962 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111497 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00359509 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00359509 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.25/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00567613 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0133565 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00564976 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00564976 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.25/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00431395 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0146635 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00444426 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00431395 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.25/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00399416 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011008 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00367648 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00367648 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.25/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00546336 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0127893 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00361086 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00361086 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.25/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00474588 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0147936 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00469958 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00469958 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.25/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00438525 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116199 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00370884 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00370884 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: /model.25/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00547708 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114711 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00414472 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00414472 [04/18/2023-18:31:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(409600,400,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.28/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00774015 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01856 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0038977 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0038977 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(409600,400,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.28/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0128408 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112587 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.012867 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0112587 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.28/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00779332 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117229 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00781233 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00779332 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.28/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0116375 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112137 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00428181 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00428181 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.28/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00882178 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0147406 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00885109 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00882178 [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.28/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00512049 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113164 [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00414485 [04/18/2023-18:31:25] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00414485 [04/18/2023-18:31:25] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:25] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.29/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:25] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00519739 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111209 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00352981 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00352981 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.29/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00795175 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113684 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00800813 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00795175 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.29/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00516196 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112264 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00517224 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00516196 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.29/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00763597 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110797 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00388608 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00388608 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.29/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00637853 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0134579 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00640477 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00637853 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.29/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00442694 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109904 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00604324 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00442694 [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.29/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00519657 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011277 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00354944 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00354944 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.29/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00796114 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0133611 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00796749 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00796114 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.29/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00518775 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112587 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00517731 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00517731 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.29/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00761744 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112672 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00398933 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00398933 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.29/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00637535 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112264 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00636641 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00636641 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.29/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00441378 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117229 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00597352 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00441378 [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) long-strided -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00438012 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114331 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345752 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00345752 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) long-strided -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00565591 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111395 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00569653 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00565591 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) long-strided -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00428383 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.014801 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0053528 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00428383 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) long-strided -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00543458 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115914 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00369383 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00369383 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) long-strided -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00470282 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110808 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00517943 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00470282 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) long-strided -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00446443 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.014816 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00408346 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00408346 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00395849 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0420937 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00424215 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00395849 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00436668 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0136158 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00344109 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00344109 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00558664 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0157315 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00548639 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00548639 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00431516 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113009 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00454 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00431516 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00428948 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115358 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00360046 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00360046 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00553758 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0182497 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00404952 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00404952 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00471668 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112542 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00468866 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00468866 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00531386 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115998 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00415935 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00415935 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.36/Concat_/model.29/act/LeakyRelu_output_0_clone_1) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00549591 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.018868 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00405308 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00405308 [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) long-strided -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) long-strided -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) long-strided -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) long-strided -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) long-strided -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) long-strided -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) long-strided -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) long-strided -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) long-strided -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) long-strided -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) long-strided -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) long-strided -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00388781 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0421669 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0042595 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00388781 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00439079 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011194 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345644 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00345644 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00564062 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115822 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00559824 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00559824 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00424632 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109966 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00442085 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00424632 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00434535 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117475 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0035992 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0035992 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00585125 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113987 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00359794 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00359794 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00468689 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112865 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00469471 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00468689 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00439023 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111458 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00512157 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00439023 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00562673 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011021 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00360811 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00360811 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,400,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,400,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400:4,20,1) -> Int8(12800,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) -> Int8(409600,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:32,20,1) -> Int8(102400,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) long-strided -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) long-strided -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) long-strided -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) long-strided -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) long-strided -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) long-strided -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(204800,400,20,1) long-strided -> Float(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00633222 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0136993 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00632626 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00632626 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(204800,400,20,1) long-strided -> Half(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00528343 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0122518 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00539632 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00528343 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(6400,400:32,20,1) long-strided -> Float(204800,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00411846 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111828 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00433399 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00411846 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(6400,400:32,20,1) long-strided -> Half(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00633838 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103967 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00636303 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00633838 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Half(6400,400:32,20,1) long-strided -> Float(204800,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00424551 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0125928 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00560932 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00424551 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Half(6400,400:32,20,1) long-strided -> Float(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00693181 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111469 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0069403 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00693181 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Float(204800,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00453257 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109737 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00434133 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00434133 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Float(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0063193 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0188411 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00632427 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0063193 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Half(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00528849 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112767 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00527935 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00527935 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Float(204800,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00412748 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011104 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00431583 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00412748 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Float(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00736686 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109953 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00479253 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00479253 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00635508 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103396 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00638549 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00635508 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Float(204800,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00415334 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106042 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00442473 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00415334 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Float(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00696316 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058123 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00696816 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0058123 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Half(6400,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.37/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00399581 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00696869 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232723 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00232723 [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(204800,400,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.38/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266404 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0535406 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00327938 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266404 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(204800,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.38/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00346242 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587776 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346765 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00346242 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(204800,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.38/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00517763 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585582 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00515233 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00515233 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(6400,400:32,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.38/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00417659 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00580462 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00419853 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00417659 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(6400,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.38/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0042275 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00719726 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00424027 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0042275 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(6400,400:32,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.38/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00614971 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00825071 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.006156 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00614971 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Half(6400,400:32,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.38/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00442916 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00657143 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0044444 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00442916 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Half(6400,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.38/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00355468 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589385 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00356282 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00355468 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Half(6400,400:32,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.38/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.004425 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00577335 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0044106 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0044106 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.39/Resize_output_0 -> ) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00438234 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587136 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00438677 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00438234 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.39/Resize_output_0 -> ) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00314942 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00961585 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00316969 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00314942 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.39/Resize_output_0 -> ) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00443678 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587356 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249088 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249088 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.39/Resize_output_0 -> ) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00388967 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00683238 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00389992 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00388967 [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.41/Concat_/model.39/Resize_output_0_clone_1 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00299305 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00681099 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0029919 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0029919 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.41/Concat_/model.39/Resize_output_0_clone_1 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00515477 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586642 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00287607 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00287607 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.41/Concat_/model.39/Resize_output_0_clone_1 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0083421 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590427 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00811352 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00590427 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.41/Concat_/model.39/Resize_output_0_clone_1 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00625828 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00868948 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00615067 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00615067 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.41/Concat_/model.39/Resize_output_0_clone_1 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0039906 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00698057 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349937 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00349937 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.41/Concat_/model.39/Resize_output_0_clone_1 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00830502 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586789 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00272155 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00272155 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) long-strided -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00383158 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584027 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00272112 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00272112 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) long-strided -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.005408 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589257 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00539293 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00539293 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) long-strided -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00380199 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00717532 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0038003 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0038003 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) long-strided -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00541833 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111213 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00256604 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00256604 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) long-strided -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00453257 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00627717 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00457472 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00453257 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) long-strided -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344152 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0061341 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283545 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00283545 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00281161 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00623126 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00280919 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00280919 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00381137 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00625709 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271034 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00271034 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0056429 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601981 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00550558 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00550558 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00380547 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00580828 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00380415 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00380415 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0029919 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00674307 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00273001 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00273001 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0057397 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598667 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251846 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00251846 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00452314 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00627498 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00451543 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00451543 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00345861 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585618 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283572 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00283572 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.46/Concat_/model.42/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0057366 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590738 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243859 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00243859 [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.44/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00381955 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587557 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271086 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00271086 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.44/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00563112 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594779 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00560914 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00560914 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.44/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00380559 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587337 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00379344 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00379344 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.44/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00543018 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585362 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253971 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00253971 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.44/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.004513 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629863 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00452529 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.004513 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.44/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344675 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587776 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00284163 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00284163 [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.44/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00382484 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587666 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00272337 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00272337 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.44/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00565081 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594743 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00561758 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00561758 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.44/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00380283 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588526 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00380511 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00380283 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.44/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00544593 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591305 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254765 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00254765 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.44/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00451086 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00631135 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.004523 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00451086 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.44/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00345557 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593591 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00284719 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00284719 [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) long-strided -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) long-strided -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) long-strided -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) long-strided -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) long-strided -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) long-strided -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.45/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00281618 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599714 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00280569 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00280569 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.45/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00382268 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589147 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271828 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00271828 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.45/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00566365 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591653 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00564097 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00564097 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.45/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00380114 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586423 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00380716 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00380114 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.45/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.002998 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585838 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00274545 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00274545 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.45/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00557574 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00583772 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254268 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00254268 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.45/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00452614 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00628074 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00452229 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00452229 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.45/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00345426 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589111 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00282953 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00282953 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.45/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00568158 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587099 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242394 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00242394 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.44/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00281699 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602743 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00281152 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00281152 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.44/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00383302 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610286 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00272466 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00272466 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.44/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00550418 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596381 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00549697 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00549697 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.44/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00387373 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00665226 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00381498 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00381498 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.44/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00305294 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100834 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00280053 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00280053 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.44/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00550119 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598514 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266777 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00266777 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.44/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00453014 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629843 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.004532 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00453014 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.44/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00345143 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593353 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0028587 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0028587 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.44/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00558769 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616076 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246983 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246983 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) long-strided -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0100224 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599467 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0100239 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00599467 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) long-strided -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00803429 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587246 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00798705 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00587246 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) long-strided -> Float(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00544711 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00665932 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00546811 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00544711 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) long-strided -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0100547 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00578633 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.01003 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00578633 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) long-strided -> Float(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00542815 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630738 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0054229 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0054229 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) long-strided -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0110618 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599867 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0110706 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00599867 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00259037 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603581 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267293 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00259037 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0100517 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00725943 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0100623 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00725943 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00802108 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594231 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00803124 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00594231 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(6400,1600:32,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.005472 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00661153 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00546353 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00546353 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(6400,1600:32,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0121775 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619372 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266591 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00266591 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(6400,1600:32,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0100581 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596648 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0100489 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00596648 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Half(6400,1600:32,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00543035 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591049 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00543814 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00543035 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Half(6400,1600:32,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0110344 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606895 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0110674 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00606895 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Half(6400,1600:32,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.47/act/LeakyRelu_output_0) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0058101 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610971 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240031 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240031 [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.48/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00301076 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0994743 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00299933 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00299933 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.48/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00453171 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607886 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00453443 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00453171 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.48/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.007472 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611086 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00749623 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00611086 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.48/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00550295 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059661 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00550927 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00550295 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.48/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00592091 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600781 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00592549 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00592091 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.48/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00935972 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604362 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00933714 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00604362 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.48/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00587593 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00909086 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00588197 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00587593 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.48/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00441891 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611486 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00440589 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00440589 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.48/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0056102 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609067 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00561389 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0056102 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.51/Concat_/model.49/Resize_output_0_clone_1 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00330306 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00871153 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00329205 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00329205 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.51/Concat_/model.49/Resize_output_0_clone_1 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00756186 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00633819 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00362812 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00362812 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.51/Concat_/model.49/Resize_output_0_clone_1 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0124834 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0063521 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0124842 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0063521 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.51/Concat_/model.49/Resize_output_0_clone_1 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00894943 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0129131 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0089124 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0089124 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.51/Concat_/model.49/Resize_output_0_clone_1 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00502195 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610476 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334597 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00334597 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: /model.51/Concat_/model.49/Resize_output_0_clone_1 copy (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0123714 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626405 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00302352 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00302352 [04/18/2023-18:31:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:26] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) long-strided -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00507082 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605238 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00286949 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00286949 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) long-strided -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00776012 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614743 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00774544 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00614743 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) long-strided -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0051102 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0063678 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00512343 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0051102 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) long-strided -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00753732 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608229 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00258049 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00258049 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) long-strided -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00602552 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00888121 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0060461 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00602552 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) long-strided -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00395737 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607543 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00288731 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00288731 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0029732 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00657538 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00300495 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0029732 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00509289 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608457 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00286034 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00286034 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00777263 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614209 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00774328 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00614209 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00511575 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00636402 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00511118 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00511118 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00319502 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607619 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00329236 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00319502 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00760301 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615219 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00256221 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00256221 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00602267 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00889681 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00601181 [04/18/2023-18:31:26] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00601181 [04/18/2023-18:31:26] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00394576 [04/18/2023-18:31:26] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060981 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00289883 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00289883 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.56/Concat_/model.52/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00813486 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617505 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254789 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00254789 [04/18/2023-18:31:27] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(51200,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.54/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00509021 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610991 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00287689 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00287689 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.54/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0077825 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615962 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00776758 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00615962 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(204800,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.54/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00510203 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00640835 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00510612 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00510203 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.54/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00757125 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607143 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254051 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00254051 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(204800,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.54/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00603657 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00893257 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00604152 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00603657 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(51200,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.54/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00395033 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606095 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0029175 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0029175 [04/18/2023-18:31:27] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(51200,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.54/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00511494 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603257 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0028619 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0028619 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.54/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00776132 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615143 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00775098 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00615143 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(204800,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.54/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00510743 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00637993 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00511037 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00510743 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.54/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00756884 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605448 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255902 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00255902 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(204800,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.54/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00602991 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00892074 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00600457 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00600457 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(51200,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.54/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00394452 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613162 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00288676 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00288676 [04/18/2023-18:31:27] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(51200,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(204800,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(204800,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(51200,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(51200,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(204800,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(204800,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(51200,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) long-strided -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) long-strided -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) long-strided -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) long-strided -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) long-strided -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) long-strided -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.55/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00301171 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00669984 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00298314 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00298314 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.55/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00510628 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107406 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00307949 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00307949 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.55/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00774208 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107344 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00774135 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00774135 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.55/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00508311 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107079 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00509273 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00508311 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.55/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00353539 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100955 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00327906 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00327906 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.55/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00757943 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114033 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00322265 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00322265 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.55/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00602819 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107089 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00602476 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00602476 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.55/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00394378 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108908 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00302495 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00302495 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.55/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00812546 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111585 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00314067 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00314067 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:27] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.54/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00319929 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104245 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00336351 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00319929 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.54/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00511053 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010197 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00302943 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00302943 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.54/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00776806 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100645 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00774568 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00774568 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.54/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00510266 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101626 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00510694 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00510266 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.54/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00336255 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113456 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00328914 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00328914 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(51200,6400:4,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.54/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0075597 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101714 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00315667 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00315667 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.54/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00602229 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010575 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0061219 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00602229 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.54/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00393192 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0131907 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00300495 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00300495 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(6400,6400:32,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.54/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0081887 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109104 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00278339 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00278339 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:27] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) long-strided -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) long-strided -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) long-strided -> Float(409600,1600,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) long-strided -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) long-strided -> Float(409600,1600,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) long-strided -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(204800,1600,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(6400,1600:32,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(6400,1600:32,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(6400,1600:32,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Half(6400,1600:32,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Half(6400,1600:32,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Half(6400,1600:32,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(409600,6400,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(12800,6400:32,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.60/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00376217 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.195584 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00386681 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00376217 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.60/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00677403 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597619 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00302038 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00302038 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.60/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0120114 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617657 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0120118 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00617657 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.60/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00863677 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00652197 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00859563 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00652197 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.60/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00908743 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006188 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00906714 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.006188 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.60/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0158427 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00625471 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0158427 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00625471 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.60/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00842326 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130527 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0084195 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0084195 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.60/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00588416 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00622191 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00586898 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00586898 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.60/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00830629 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599371 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00831238 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00599371 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:27] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.61/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00376277 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.195584 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00375373 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00375373 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.61/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00674431 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603848 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00301914 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00301914 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.61/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0119855 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104415 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0119768 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0104415 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.61/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00859106 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103282 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00862279 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00859106 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.61/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00908657 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103863 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00907657 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00907657 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.61/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0158441 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00990202 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0158267 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00990202 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.61/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00858998 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0135223 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00847328 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00847328 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.61/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00588288 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104829 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00588233 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00588233 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: /model.61/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00832889 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106498 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00833397 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00832889 [04/18/2023-18:31:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:27] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(819200,6400,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(204800,6400:4,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(25600,6400:32,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) long-strided -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) long-strided -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) long-strided -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) long-strided -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) long-strided -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) long-strided -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-18:31:27] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0324599 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0256907 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0326235 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0256907 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.03632 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0241653 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0364229 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0241653 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0641844 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0242126 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.064317 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0242126 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Float(1:4,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0999863 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0711436 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0989737 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0711436 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0154478 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0172643 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0240891 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0154478 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0197611 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0224346 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0174893 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0174893 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0341193 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0172267 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0179234 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0172267 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0341861 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.017475 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0342098 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.017475 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0483718 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.017187 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0481143 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.017187 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Half(1:8,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.139483 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0716069 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.052419 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.052419 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Half(1632000:32,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.02619 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.315685 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.02709 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.315685 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0328823 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0577829 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0330313 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0328823 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Float(409600,1:4,5120,64) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.024291 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0355218 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0242301 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0242301 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Float(51200,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.086992 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0384384 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0868206 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0384384 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Float(1:4,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.180777 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0771909 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.179931 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0771909 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Half(1632000,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0310656 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0364617 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0310062 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0310062 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Half(819200,6400:2,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0316928 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0364674 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0316946 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0316928 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Half(204800,1:8,2560,32) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0211252 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0366446 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0212996 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0211252 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Half(102400,1:16,1280,16) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0211487 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173968 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0208771 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0173968 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Half(51200,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0672762 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0172292 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0673966 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0172292 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Half(1:8,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.208018 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0770194 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.212114 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0770194 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Half(1632000:32,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.12934 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.278528 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.273 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.278528 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0332626 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0254537 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0330752 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0254537 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Float(1632000,1,20400,255) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0230224 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0418343 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0230694 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0230224 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Float(51200,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0894537 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.03968 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0848457 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.03968 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Float(1:4,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.176759 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0771634 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.176274 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0771634 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Half(1632000,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0302318 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0386487 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0301934 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0301934 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Half(819200,6400:2,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0306322 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0441051 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0306514 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0306322 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Half(204800,1:8,2560,32) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0240175 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0354505 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0236578 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0236578 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Half(102400,1:16,1280,16) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0235102 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0344622 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0235716 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0235102 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Half(51200,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0654552 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0351086 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0653989 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0351086 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Half(1:8,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.205531 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0758491 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.207141 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0758491 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Half(1632000:32,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.26597 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.350939 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.29362 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.350939 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0286427 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0476404 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0287003 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0286427 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.024381 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0303397 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0235311 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0235311 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0257539 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0337728 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0263299 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0257539 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Float(1:4,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.168667 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0774583 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.168667 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0774583 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0264526 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0337655 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0264076 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0264076 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0275086 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0346405 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.028013 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0275086 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0236624 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0487619 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0325294 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0236624 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0236983 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0221009 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0237897 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0221009 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0621288 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0176777 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.062173 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0176777 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Half(1:8,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.205957 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0763611 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.199534 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0763611 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Half(1632000:32,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.25505 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.358094 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.21375 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.358094 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0529554 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.791552 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0499794 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0499794 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0517455 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.733339 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0520777 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0517455 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0547611 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.668526 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0557349 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0547611 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0669989 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.714034 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0671451 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0669989 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.04556 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.342656 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.045872 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.04556 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0453223 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.315392 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0458606 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0453223 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0484206 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.362894 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0483231 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0483231 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0480792 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.313051 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0485181 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0480792 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0496396 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.36235 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0491032 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0491032 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Half(1:8,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.165449 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.341257 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.168082 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.165449 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Half(1632000:32,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.30898 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.297253 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.40202 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.297253 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.01773 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0402578 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0218971 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.01773 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0310711 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0330322 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0310126 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0310126 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.035371 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0338505 [04/18/2023-18:31:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0353344 [04/18/2023-18:31:27] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0338505 [04/18/2023-18:31:27] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-18:31:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.067779 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0347282 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0646095 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0347282 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Float(1:4,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0935497 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.313198 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0966949 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0935497 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0220761 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0331557 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0138967 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0138967 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0314121 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0359429 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0150597 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0150597 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0314377 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0354002 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0311003 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0311003 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0458549 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0306249 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0458126 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0306249 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Half(1:8,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.131657 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0685592 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0493471 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0493471 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Half(1632000:32,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.46668 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.210651 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.56469 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.210651 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0215047 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0324782 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0180109 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0180109 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0247467 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0320421 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0241006 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0241006 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0267269 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0371177 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.037632 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0267269 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0642682 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.036032 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0642697 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.036032 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Float(1:4,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.164571 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.317294 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.168375 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.164571 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0181263 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0521265 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.014282 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.014282 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0230243 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0382903 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0135909 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0135909 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.023215 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0406846 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0271421 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.023215 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.046336 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0322615 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0462994 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0322615 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Half(1:8,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.196169 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.085504 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.196352 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.085504 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Half(1632000:32,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.17206 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.224402 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.25968 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.224402 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0306377 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0360697 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0176914 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0176914 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Float(1632000,1,20400,255) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0212859 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0395577 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0211951 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0211951 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Float(409600,1:4,5120,64) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0251665 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0425691 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0249859 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0249859 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Float(51200,6400:32,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0840457 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0431531 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0811817 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0431531 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Float(1:4,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.16613 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.388978 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.166181 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.16613 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Half(1632000,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0233887 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.042944 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0131608 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0131608 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Half(819200,6400:2,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0243566 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.055395 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0125623 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0125623 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Half(102400,1:16,1280,16) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0224451 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0271413 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0220558 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0220558 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Half(51200,6400:32,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.062627 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0329143 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0623909 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0329143 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Half(1:8,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.196754 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0756297 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.196462 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0756297 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Half(1632000:32,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.18037 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.219282 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.24915 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.219282 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0301275 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0503558 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0302574 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0301275 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Float(1632000,1,20400,255) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0210018 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0341678 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0209783 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0209783 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Float(409600,1:4,5120,64) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0265981 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0339968 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0249371 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0249371 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Float(51200,6400:32,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0819977 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0400114 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0810423 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0400114 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Float(1:4,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.165888 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.389239 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.166327 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.165888 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Half(1632000,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0239935 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0396069 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0234625 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0234625 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Half(819200,6400:2,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0244785 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.044544 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0243291 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0243291 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Half(204800,1:8,2560,32) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0222883 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0397806 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0219638 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0219638 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Half(51200,6400:32,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0622918 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0407657 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0624152 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0407657 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Half(1:8,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.202752 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.075648 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.196608 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.075648 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Half(1632000:32,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.22546 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.219419 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.01948 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.219419 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0248792 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0332946 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0249166 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0248792 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0215634 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0333522 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0217757 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0215634 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0248922 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0337408 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0249905 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0248922 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0718263 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0341723 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0718263 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0341723 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Float(1:4,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.163547 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.316722 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.163255 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.163255 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.023616 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0373394 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.023665 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.023616 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0237329 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0332069 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0237819 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0237329 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0221727 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0331401 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0221649 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0221649 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0220663 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0350126 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0221936 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0220663 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Half(1:8,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.193975 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0762149 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.194267 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0762149 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Half(1632000:32,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.05971 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.22016 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.02109 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.22016 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0528091 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.219282 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0498895 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0498895 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0515337 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.225678 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0514438 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0514438 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0553905 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.226066 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0549501 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0549501 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0661211 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.225573 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0661851 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0661211 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Float(1:4,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.131803 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.367177 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.128805 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.128805 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0450606 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.02535 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.045064 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0450606 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0451577 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.01405 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0454983 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0451577 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0482255 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.01435 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0484328 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0482255 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0483063 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.01435 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0479893 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0479893 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0508495 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.05659 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0516389 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0508495 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Half(1632000:32,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 3.07288 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.301202 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 3.05284 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.301202 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0877874 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.224256 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0876343 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0876343 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.166619 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.228791 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.163872 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.163872 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.166034 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.228645 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.166766 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.166034 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0913554 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.229522 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0913646 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0913554 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Float(1:4,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.161545 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.376101 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.164864 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.161545 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.082944 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.04097 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0832366 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.082944 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0831612 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.02462 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0826514 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0826514 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.161079 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.02488 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.160183 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.160183 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.160329 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.02488 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.160037 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.160037 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0831634 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.05925 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0838217 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0831634 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Half(1:8,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.0/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.208165 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.118126 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.207579 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.118126 [04/18/2023-18:31:28] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Half(409600,1:4,5120,64) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0355529 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0434891 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0357714 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0355529 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,6400,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Float(409600,1:4,5120,64) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Float(51200,6400:32,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Half(1632000,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Half(819200,6400:2,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Half(409600,1:4,5120,64) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0219631 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0391886 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0219892 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0219631 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Half(204800,1:8,2560,32) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Half(102400,1:16,1280,16) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1632000,1,20400,255) -> Half(51200,6400:32,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Float(1632000,1,20400,255) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Float(51200,6400:32,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Half(1632000,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Half(819200,6400:2,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Half(409600,1:4,5120,64) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.024365 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0433829 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0243909 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.024365 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Half(204800,1:8,2560,32) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Half(102400,1:16,1280,16) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(409600,1:4,5120,64) -> Half(51200,6400:32,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Half(409600,1:4,5120,64) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0244297 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0412526 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0248952 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0244297 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(51200,6400:32,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Half(409600,1:4,5120,64) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0482255 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.310409 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0481844 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0481844 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,6400,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Half(409600,1:4,5120,64) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0321774 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0500328 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0313637 [04/18/2023-18:31:28] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0313637 [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(1632000,6400,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-18:31:28] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Half(409600,1:4,5120,64) *************** [04/18/2023-18:31:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0232895 [04/18/2023-18:31:28] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0270872 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0230779 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0230779 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(819200,6400:2,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(409600,1:4,5120,64) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0298734 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0241371 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0299803 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0241371 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(409600,1:4,5120,64) -> Float(1632000,1,20400,255) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0208496 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0200497 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0207889 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0200497 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(409600,1:4,5120,64) -> Float(409600,1:4,5120,64) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0247543 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0194006 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0246842 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0194006 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(409600,1:4,5120,64) -> Float(51200,6400:32,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0810423 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0194817 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0805303 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0194817 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(409600,1:4,5120,64) -> Half(1632000,6400,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0231602 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.036096 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0231726 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0231602 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(409600,1:4,5120,64) -> Half(819200,6400:2,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0243413 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0192726 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0243101 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0192726 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(409600,1:4,5120,64) -> Half(204800,1:8,2560,32) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.021903 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.013083 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0219011 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.013083 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(409600,1:4,5120,64) -> Half(102400,1:16,1280,16) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0221531 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012907 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0220591 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.012907 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(409600,1:4,5120,64) -> Half(51200,6400:32,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0628648 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012776 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0628541 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.012776 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Float(1632000,1,20400,255) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Float(409600,1:4,5120,64) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Float(51200,6400:32,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Half(1632000,6400,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Half(819200,6400:2,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Half(409600,1:4,5120,64) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0221146 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0129269 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0221851 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0129269 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Half(102400,1:16,1280,16) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204800,1:8,2560,32) -> Half(51200,6400:32,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Float(1632000,1,20400,255) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Float(409600,1:4,5120,64) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Float(51200,6400:32,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Half(1632000,6400,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Half(819200,6400:2,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Half(409600,1:4,5120,64) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0221055 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012928 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.022129 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.012928 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Half(204800,1:8,2560,32) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:16,1280,16) -> Half(51200,6400:32,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Half(409600,1:4,5120,64) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0222772 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012605 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0222988 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.012605 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(51200,6400:32,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Half(409600,1:4,5120,64) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0480305 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.00337 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0480305 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0480305 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1:8,6400,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Float(1632000,1,20400,255) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Float(409600,1:4,5120,64) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Half(409600,1:4,5120,64) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.160622 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 1.01683 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.16267 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.160622 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Half(204800,1:8,2560,32) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Half(102400,1:16,1280,16) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,6400,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-18:31:29] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0269859 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0383269 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0266895 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0266895 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0270133 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0392411 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0271063 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0270133 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.114496 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0415817 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.113573 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0415817 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0165628 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0446846 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0237825 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0165628 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.020096 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0410331 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0175228 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0175228 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0243284 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0320366 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0242347 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0242347 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0242324 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.02048 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0160533 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0160533 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0241943 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0184006 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0241669 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0184006 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0635992 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.017908 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0634392 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.017908 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0323319 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.025981 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0323017 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.025981 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0227494 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0239261 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0227252 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0227252 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.128219 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0265089 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.128293 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0265089 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0299301 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0191749 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0298725 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0191749 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.031861 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0206668 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0317367 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0206668 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.020032 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0176808 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0200903 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0176808 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0200063 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0174557 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.020096 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0174557 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.020352 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0176234 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0203154 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0176234 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0841874 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0181834 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0840411 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0181834 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0334199 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0262827 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0334939 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0262827 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0229623 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0240693 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0229257 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0229257 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.131234 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0257463 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.131438 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0257463 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0312539 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01922 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0311954 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.01922 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0323191 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.020894 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0322999 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.020894 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0234109 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0177478 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0232007 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0177478 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0231549 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173298 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.023138 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0173298 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0232229 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.017598 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0231373 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.017598 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0841143 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0182669 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0840411 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0182669 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0300178 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.026429 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0300809 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.026429 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0233456 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0236885 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0233032 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0233032 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0241836 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0239634 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0241196 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0239634 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0276015 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0191269 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0275467 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0191269 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0280625 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0203823 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0286528 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0203823 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0235311 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0177991 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.023744 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0177991 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0236493 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0180789 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0234051 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0180789 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0233176 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0176996 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.023281 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0176996 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0804617 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.018184 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0817257 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.018184 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0171149 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0187651 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0214811 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0171149 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0249646 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0192206 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0249539 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0192206 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0255512 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.018848 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0256183 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.018848 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.113957 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0209789 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.113225 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0209789 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0184217 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0133407 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0137646 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0133407 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0220846 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0374491 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0220415 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0220415 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0219161 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121135 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0113164 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0113164 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0220056 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011957 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0218704 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.011957 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0640609 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0142309 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0641219 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0142309 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0205949 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0199714 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0175883 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0175883 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0228238 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0187806 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0228323 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0187806 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.024323 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0185623 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0241897 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0185623 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.111173 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.020945 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.11147 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.020945 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0180789 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0409257 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0128979 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0128979 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0219997 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0160218 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0219233 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0160218 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0219494 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0158928 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0104294 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0104294 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0218945 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0159477 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0219298 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0159477 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0428331 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0157435 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0427463 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0157435 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0297454 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0194269 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0296686 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0194269 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0207523 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0185286 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0207739 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0185286 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0233221 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0195497 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0234266 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0195497 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.127854 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0210155 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.127627 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0210155 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.023824 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0365303 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0236735 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0236735 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0256731 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.019224 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.025677 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.019224 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0215765 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0149403 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0216085 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0149403 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0216209 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0149243 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0215595 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0149243 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0801646 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0150802 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0806766 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0150802 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0300425 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0194926 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0169879 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0169879 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0208562 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0186829 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.020894 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0186829 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0236147 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0186429 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0234893 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0186429 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.128578 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0218364 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.127781 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0218364 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.023853 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0365977 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00853943 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00853943 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0256305 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0192651 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00835048 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00835048 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0216503 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0148581 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0216176 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0148581 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0216144 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.014965 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0215491 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.014965 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0800183 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0149883 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0801623 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0149883 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0295525 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0193097 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0295762 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0193097 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0208849 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0186074 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0207301 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0186074 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0232921 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0186286 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0232999 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0186286 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.127561 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0207373 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.127655 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0207373 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0238728 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0364731 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0238804 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0238728 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0256488 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0192509 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0256693 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0192509 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0215621 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0150217 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0217711 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0150217 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0217378 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0149504 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0218527 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0149504 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0807497 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0151145 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0808229 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0151145 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0246575 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0189834 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0246354 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0189834 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.021218 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0184863 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.021231 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0184863 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0240823 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0190686 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0236428 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0190686 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.121054 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0214655 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.119954 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0214655 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0243848 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.03712 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.024253 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.024253 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0149038 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0192469 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.014667 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.014667 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0221296 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0154226 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0223438 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0154226 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0222243 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0151241 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.022046 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0151241 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_output_0) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0220304 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0153307 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0220682 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0153307 [04/18/2023-18:31:29] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0152983 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0178691 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.023933 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0152983 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0201611 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0211892 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0178709 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0178709 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.024365 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0174918 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.016319 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.016319 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0332069 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0268434 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0330578 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0268434 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0301824 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0195406 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0305335 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0195406 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0320402 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0208653 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0320713 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0208653 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0203269 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.017928 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.020316 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.017928 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0334062 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0268137 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0345527 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0268137 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0311662 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0193257 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0312174 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0193257 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0324736 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0213544 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0330021 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0213544 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0238438 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01792 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0238331 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.01792 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0308891 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0267634 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0305106 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0267634 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.028179 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0194703 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0281463 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0194703 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.028336 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0206681 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0285021 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0206681 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0241349 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0174171 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0241402 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0174171 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0173862 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0189806 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0216908 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0173862 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0188686 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0137413 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0139811 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0137413 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0225437 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119288 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0116033 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0116033 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0210096 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0204591 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0177067 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0177067 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0188211 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0428629 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0132783 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0132783 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.02272 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0166684 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.010494 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.010494 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0303195 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.02026 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0305774 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.02026 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0242057 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0373703 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0241912 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0241912 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0261067 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0197486 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0259992 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0197486 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0220709 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0154167 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0221016 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0154167 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.030485 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0196754 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0171139 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0171139 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0242164 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0379611 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00856686 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00856686 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0264625 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0201149 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00852114 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00852114 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0303918 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0204382 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0303899 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0204382 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0247406 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0381749 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0247543 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0247406 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0264533 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0201229 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0262583 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0201229 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.022366 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0153893 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0222968 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0153893 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0252373 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0193891 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0252015 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0193891 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0249547 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.038168 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0249493 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0249493 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0152992 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0198549 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0151241 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0151241 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_output_0 -> ) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0225907 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.015477 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0225352 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.015477 [04/18/2023-18:31:29] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) long-strided -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0260175 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.030411 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0259733 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0259733 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) long-strided -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0263337 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.030293 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0264282 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0263337 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) long-strided -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.110153 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.030603 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.109641 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.030603 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) long-strided -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0184691 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0208803 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.018432 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.018432 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) long-strided -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0196257 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0243345 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.019596 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.019596 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) long-strided -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0240884 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0180097 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.024035 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0180097 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) long-strided -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0241128 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0178834 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.024051 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0178834 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) long-strided -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0241859 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0179606 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0241684 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0179606 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) long-strided -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.063168 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.019552 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0647558 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.019552 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) long-strided -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0190406 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0209156 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0193406 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0190406 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) long-strided -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0240152 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0187891 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0240861 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0187891 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) long-strided -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.024771 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0187651 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0245996 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0187651 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) long-strided -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.10869 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0201149 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.10893 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0201149 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) long-strided -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0180691 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.017185 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0181509 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.017185 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) long-strided -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0209496 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0362057 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0209228 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0209228 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) long-strided -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0210344 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0153838 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0209352 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0153838 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) long-strided -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0210064 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0154208 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0209763 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0154208 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) long-strided -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0627078 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0181771 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0628541 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0181771 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) long-strided -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0202069 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0223419 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0201589 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0201589 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) long-strided -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0222563 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0191817 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0222393 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0191817 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) long-strided -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0239124 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0193143 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0239124 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0193143 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) long-strided -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.109129 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0206583 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.109289 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0206583 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) long-strided -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.017992 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0518293 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0180097 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.017992 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) long-strided -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0217489 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.017569 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0216888 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.017569 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) long-strided -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0216849 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0176645 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0216705 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0176645 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) long-strided -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0216287 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0176356 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0217241 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0176356 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) long-strided -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0421623 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173084 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0420651 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0173084 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) long-strided -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0302811 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0215876 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.030027 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0215876 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) long-strided -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0206629 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0176777 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0206328 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0176777 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) long-strided -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0232176 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0176965 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0232869 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0176965 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) long-strided -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.124928 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0206286 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.125147 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0206286 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) long-strided -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0239909 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0463737 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0239154 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0239154 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) long-strided -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0258293 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0229851 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0258103 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0229851 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) long-strided -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0213649 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0153723 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0213917 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0153723 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) long-strided -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0213773 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0150103 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0213336 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0150103 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) long-strided -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0792251 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0162372 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.078848 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0162372 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1555200,518400,6480,81,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0219638 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0242781 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0220147 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0219638 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1555200,518400,6480,81,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0249813 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0300096 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0251131 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0249813 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1555200,518400,6480,81,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0253829 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0300389 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0253806 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0253806 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1555200,518400,6480,81,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.108889 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0301641 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.108907 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0301641 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1555200,518400,6480,81,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0180651 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0208157 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0182389 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0180651 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1555200,518400,6480,81,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0195086 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0241166 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0195651 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0195086 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1555200,518400,6480,81,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0232209 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0178413 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0232424 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0178413 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1555200,518400,6480,81,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0232993 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0178083 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0232451 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0178083 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1555200,518400,6480,81,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0231896 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0177773 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0231817 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0177773 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Float(1555200,518400,6480,81,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0623665 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0191617 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0623269 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0191617 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1555200,518400,6480,81,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0186931 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0207308 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0188903 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0186931 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1555200,518400,6480,81,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0239817 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.018596 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0239429 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.018596 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1555200,518400,6480,81,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0245531 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0185589 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0245752 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0185589 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1555200,518400,6480,81,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.107813 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.019816 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.107813 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.019816 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1555200,518400,6480,81,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0155918 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0536731 [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.015627 [04/18/2023-18:31:29] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0155918 [04/18/2023-18:31:29] [V] [TRT] *************** Autotuning Reformat: Half(1555200,518400,6480,81,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:29] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0174461 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0166116 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0172663 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0166116 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(1555200,518400,6480,81,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0201874 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0356645 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0201217 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0201217 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(1555200,518400,6480,81,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0201789 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.014976 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0202269 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.014976 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(1555200,518400,6480,81,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.020096 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0149751 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0200531 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0149751 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(1555200,518400,6480,81,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0616351 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0178891 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0614827 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0178891 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(777600,259200,6480:2,81,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0199183 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0220682 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.019908 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.019908 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(777600,259200,6480:2,81,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0218632 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0189326 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0218384 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0189326 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(777600,259200,6480:2,81,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0233966 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0189297 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0233607 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0189297 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(777600,259200,6480:2,81,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.107301 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0201709 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.107301 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0201709 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(777600,259200,6480:2,81,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.017247 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0506636 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0172541 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.017247 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(777600,259200,6480:2,81,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.009356 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0235056 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00941829 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.009356 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(777600,259200,6480:2,81,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0211122 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0171302 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0209979 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0171302 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(777600,259200,6480:2,81,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0210795 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0171154 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0209189 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0171154 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(777600,259200,6480:2,81,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0209744 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0171627 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0209842 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0171627 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(777600,259200,6480:2,81,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0409303 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0169107 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0410697 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0169107 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,1:8,810,10) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0297518 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0211905 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.029813 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0211905 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,1:8,810,10) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0203371 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0171622 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.020224 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0171622 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,1:8,810,10) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0228415 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0175721 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0228526 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0175721 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,1:8,810,10) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.123182 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0199549 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.12288 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0199549 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,1:8,810,10) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0234854 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0455886 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0234919 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0234854 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,1:8,810,10) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0255002 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.022272 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0254705 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.022272 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,1:8,810,10) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0207353 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.014688 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0206942 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.014688 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,1:8,810,10) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0207145 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0146199 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0207784 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0146199 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,1:8,810,10) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0207562 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0146318 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0207673 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0146318 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,1:8,810,10) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_output_2) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0776777 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0160305 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0775314 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0160305 [04/18/2023-18:31:30] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-18:31:30] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-18:31:30] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00292749 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00625789 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00354676 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00292749 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00304068 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00633282 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00296359 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00296359 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0049181 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006184 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00493052 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0049181 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00302781 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600305 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00301838 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00301838 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00208457 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00925486 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00261893 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00208457 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00273285 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00807187 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00227287 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00227287 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00295407 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617219 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252006 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252006 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00290231 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605048 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00291172 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00290231 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00376156 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606971 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00375964 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00375964 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00303476 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587996 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252399 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252399 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0229407 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605067 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0228696 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00605067 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00293336 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00653984 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0029579 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00293336 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267759 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00642743 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00287269 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00267759 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00516637 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626782 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.005152 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.005152 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00384794 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00662151 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00398971 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00384794 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0036257 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100791 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00321544 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00321544 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00306373 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603505 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0032256 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00306373 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00301828 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010076 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00292879 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00292879 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00265372 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603867 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271396 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00265372 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00408076 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0064006 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00407543 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00407543 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00453157 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00652925 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.004536 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00453157 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0232124 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0067601 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0232176 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0067601 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00303581 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00711086 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00308562 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00303581 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(38400,12800,1,160,80) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266861 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626902 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267505 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266861 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00521535 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00644929 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00522057 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00521535 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038809 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00668696 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00387435 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00387435 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00305021 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601581 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00301743 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00301743 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00305469 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595829 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00302381 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00302381 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268902 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621535 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269096 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00268902 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267268 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00627518 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267835 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00267268 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00412617 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592165 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0041182 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0041182 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00454757 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00655854 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00453514 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00453514 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0232464 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00672478 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0232281 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00672478 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0029979 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00628233 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0029799 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0029799 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267784 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00645267 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026797 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00267784 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267107 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062394 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270422 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00267107 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00371716 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00659886 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00373099 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00371716 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00302362 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594652 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00305274 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00302362 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00303847 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582619 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00305157 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00303847 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270499 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586386 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268851 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00268851 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270706 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058582 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00279262 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00270706 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00407225 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589221 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00404533 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00404533 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00442293 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00650473 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00445423 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00442293 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0231967 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00669112 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0231549 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00669112 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00281484 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00985935 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283715 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00281484 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00315657 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0122781 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00312855 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00312855 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0032127 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121219 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00321707 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0032127 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00519281 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121421 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00513551 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00513551 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00281708 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00573842 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00355111 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00281708 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00300057 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00657517 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00295613 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00295613 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00315886 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00654338 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00315419 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00315419 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00510873 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00658951 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00317552 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00317552 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.003904 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00662878 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00389906 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00389906 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0031038 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00845359 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00383964 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0031038 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.022959 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584229 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.022991 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00584229 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00205923 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00914114 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237872 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00205923 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00441046 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599657 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00289545 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00289545 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00292982 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604038 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00292917 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00292917 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.004864 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00693116 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00486278 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00486278 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00290944 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584539 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00290779 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00290779 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00261444 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613276 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00277785 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00261444 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00288539 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617905 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250436 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250436 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00287095 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618228 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00285598 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00285598 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00387324 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00686171 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00401638 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00387324 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.003333 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117386 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026665 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0026665 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.023153 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617981 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0230021 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00617981 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267039 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00716582 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268085 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00267039 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271129 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594505 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271043 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00271043 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00279059 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593554 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00278303 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00278303 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00490682 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584302 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00490332 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00490332 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00328852 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0065679 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00329579 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00328852 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00261328 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608571 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0022182 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0022182 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271207 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598762 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232361 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00232361 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271517 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059392 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00273173 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00271517 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00321361 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603752 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00321564 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00321361 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00391438 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00799467 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00393167 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00391438 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0230877 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00690678 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0230988 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00690678 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00315915 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587063 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00224229 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00224229 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(38400,12800,1,160,80) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268334 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602743 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00273147 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00268334 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269139 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00785396 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0028368 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00269139 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00515722 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596667 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00522841 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00515722 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038317 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00667325 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0040943 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0038317 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00414446 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104251 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0028454 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0028454 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00312368 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100328 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00257135 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00257135 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00312487 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012163 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00327127 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00312487 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00413335 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102808 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00416104 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00413335 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00441171 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113431 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00442459 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00441171 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0233861 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673143 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0240882 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00673143 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00340731 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0131516 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00359383 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00340731 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(38400,12800,1,160,80) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266235 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606971 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267183 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266235 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270034 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607181 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270672 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00270034 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00516261 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00639086 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0051569 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0051569 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00469397 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00719108 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00381185 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00381185 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00305585 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613124 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00352424 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00305585 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034141 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0126776 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00319462 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00319462 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00435719 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121299 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00361726 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00361726 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00414733 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105989 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00414367 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00414367 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00439744 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011284 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00436655 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00436655 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0242682 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118562 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0233352 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0118562 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00329268 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102534 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00344849 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00329268 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00341638 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101413 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00357897 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00341638 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00418025 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010385 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0036432 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0036432 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00500556 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101394 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00501029 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00500556 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00353617 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113136 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00364789 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00353617 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342182 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103837 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00357166 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00342182 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00338743 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105006 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347222 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00338743 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342607 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106243 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00352825 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00342607 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00343869 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107647 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00352034 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00343869 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00402717 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118108 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00403987 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00402717 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0230531 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113262 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0230922 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0113262 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325745 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00995078 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00307258 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00307258 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342901 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113463 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00354375 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00342901 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00341007 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116578 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00352602 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00341007 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00512816 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0700221 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00513518 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00512816 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344925 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103174 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00359897 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00344925 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.003424 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112626 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00313789 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00313789 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00334182 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118449 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00344327 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00334182 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00333363 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118379 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00355222 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00333363 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00388707 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118586 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00365851 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00365851 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00402641 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0133893 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00400495 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00400495 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0230975 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00957457 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0229309 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00957457 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00330961 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104245 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00344381 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00330961 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00349781 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107641 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00358034 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00349781 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00350038 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117788 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00361029 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00350038 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00522041 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117693 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00524114 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00522041 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00350573 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00999375 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00365052 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00350573 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00346427 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112028 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0035968 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00346427 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00336074 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119364 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347766 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00336074 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033987 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118773 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349558 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0033987 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342999 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118938 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00357589 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00342999 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0040273 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130061 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00402374 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00402374 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_output_0 -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00345742 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104594 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00353405 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00345742 [04/18/2023-18:31:30] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,160,2,1) -> Float(12800,12800,1,160,80) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344239 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102488 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00360994 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00344239 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,160,2,1) -> Float(3200,3200,1:4,40,20) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00345524 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00989227 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00357943 [04/18/2023-18:31:30] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00345524 [04/18/2023-18:31:30] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,160,2,1) -> Float(480,480,160:32,2,1) *************** [04/18/2023-18:31:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342857 [04/18/2023-18:31:30] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103128 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00360834 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00342857 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,160,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00351075 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010592 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00366274 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00351075 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,160,2,1) -> Half(12800,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00297488 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103442 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00314266 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00297488 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,160,2,1) -> Half(6400,6400,160:2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00339136 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105623 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00305206 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00305206 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,160,2,1) -> Half(1600,1600,1:8,20,10) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00338785 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106642 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002994 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.002994 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,160,2,1) -> Half(800,800,1:16,10,5) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00339508 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102599 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00352636 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00339508 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,160,2,1) -> Half(480,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00338105 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00999375 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345154 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00338105 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,160,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00331616 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103654 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00294195 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00294195 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,160,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0234978 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103047 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0234684 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0103047 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,1,160,80) -> Float(12800,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00324338 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103014 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346634 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00324338 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,1,160,80) -> Float(3200,3200,1:4,40,20) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00343652 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103481 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00362606 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00343652 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,1,160,80) -> Float(480,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00343162 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010385 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346308 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00343162 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,1,160,80) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00361154 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119124 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00363337 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00361154 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,1,160,80) -> Half(12800,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00349135 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104682 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00353483 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00349135 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,1,160,80) -> Half(6400,6400,160:2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00321879 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105639 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00338647 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00321879 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,1,160,80) -> Half(1600,1600,1:8,20,10) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00340375 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102083 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00344152 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00340375 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,1,160,80) -> Half(800,800,1:16,10,5) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342792 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011316 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00410384 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00342792 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,1,160,80) -> Half(480,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00310927 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104996 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0031194 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00310927 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,1,160,80) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00392043 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00662545 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00404483 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00392043 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,12800,1,160,80) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0235696 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00820597 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0236278 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00820597 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1:4,40,20) -> Float(12800,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00327086 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00648129 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002792 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.002792 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1:4,40,20) -> Float(12800,12800,1,160,80) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00243425 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00690199 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243882 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00243425 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1:4,40,20) -> Float(480,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00346318 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630738 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00348599 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00346318 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1:4,40,20) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034948 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00686193 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00355434 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0034948 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1:4,40,20) -> Half(12800,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268089 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594725 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266946 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00266946 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1:4,40,20) -> Half(6400,6400,160:2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00272311 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610076 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00284854 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00272311 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1:4,40,20) -> Half(1600,1600,1:8,20,10) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249545 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608781 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248867 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248867 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1:4,40,20) -> Half(800,800,1:16,10,5) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00259159 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00773582 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269749 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00259159 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1:4,40,20) -> Half(480,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00298628 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611486 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00301695 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00298628 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1:4,40,20) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00409299 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00762538 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00398245 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00398245 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1:4,40,20) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0236382 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00683429 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.023569 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00683429 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(480,480,160:32,2,1) -> Float(12800,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00283563 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626147 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00277785 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00277785 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(480,480,160:32,2,1) -> Float(12800,12800,1,160,80) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254749 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00634653 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244788 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00244788 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(480,480,160:32,2,1) -> Float(3200,3200,1:4,40,20) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00260314 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00632984 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00260779 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00260314 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(480,480,160:32,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00347254 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00684865 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0034621 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0034621 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(480,480,160:32,2,1) -> Half(12800,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00272699 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601505 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00277767 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00272699 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(480,480,160:32,2,1) -> Half(6400,6400,160:2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268089 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589897 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00293169 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00268089 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(480,480,160:32,2,1) -> Half(1600,1600,1:8,20,10) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271914 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010207 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00379018 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00271914 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(480,480,160:32,2,1) -> Half(800,800,1:16,10,5) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325112 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120206 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00261793 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00261793 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(480,480,160:32,2,1) -> Half(480,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00305712 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112644 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0036064 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00305712 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(480,480,160:32,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00389584 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0096579 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0227581 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00389584 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(480,480,160:32,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0236056 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101915 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0234873 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0101915 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(12800,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00332534 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105417 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00353907 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00332534 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(12800,12800,1,160,80) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00424463 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121394 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00430763 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00424463 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(3200,3200,1:4,40,20) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00362423 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.013467 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00325454 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00325454 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(480,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00338647 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121059 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0058357 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00338647 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(12800,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00280802 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00640497 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249521 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249521 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(6400,6400,160:2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00261137 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00678878 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00262458 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00261137 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(1600,1600,1:8,20,10) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00278312 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00705458 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00282945 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00278312 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(800,800,1:16,10,5) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00278822 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0068702 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00279789 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00278822 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(480,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00303124 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00699059 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.003047 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00303124 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00284791 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605848 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00293122 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00284791 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0234096 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626961 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0234821 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00626961 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800,160,2,1) -> Float(12800,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00196133 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00622827 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00217988 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00196133 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800,160,2,1) -> Float(12800,12800,1,160,80) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00624652 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006072 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00264029 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00264029 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800,160,2,1) -> Float(3200,3200,1:4,40,20) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268233 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603543 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271517 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00268233 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800,160,2,1) -> Float(480,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00329247 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617257 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00331938 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00329247 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800,160,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00265964 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608705 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00261353 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00261353 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800,160,2,1) -> Half(6400,6400,160:2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023904 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0242387 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00216495 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00216495 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800,160,2,1) -> Half(1600,1600,1:8,20,10) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268013 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626365 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252423 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252423 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800,160,2,1) -> Half(800,800,1:16,10,5) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00260505 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00716868 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.003008 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00260505 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800,160,2,1) -> Half(480,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00315776 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111487 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00327345 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00315776 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800,160,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00304126 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616209 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248323 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248323 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800,160,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0235651 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00813562 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0236317 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00813562 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(6400,6400,160:2,2,1) -> Float(12800,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246082 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058037 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00204637 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00204637 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(6400,6400,160:2,2,1) -> Float(12800,12800,1,160,80) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254476 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00672353 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00257045 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00254476 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(6400,6400,160:2,2,1) -> Float(3200,3200,1:4,40,20) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.002572 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590318 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00256727 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00256727 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(6400,6400,160:2,2,1) -> Float(480,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0032559 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587337 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00326587 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0032559 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(6400,6400,160:2,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00332852 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00661652 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00332726 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00332726 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(6400,6400,160:2,2,1) -> Half(12800,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238111 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607657 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00205015 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00205015 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(6400,6400,160:2,2,1) -> Half(1600,1600,1:8,20,10) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252672 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604762 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00232 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(6400,6400,160:2,2,1) -> Half(800,800,1:16,10,5) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00294465 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105724 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00353962 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00294465 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(6400,6400,160:2,2,1) -> Half(480,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00340822 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106504 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00512963 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00340822 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(6400,6400,160:2,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00376096 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115277 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00452143 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00376096 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(6400,6400,160:2,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0236937 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107925 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0237002 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0107925 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,1:8,20,10) -> Float(12800,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00318882 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100303 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00388781 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00318882 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,1:8,20,10) -> Float(12800,12800,1,160,80) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00336255 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121087 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00352301 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00336255 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,1:8,20,10) -> Float(3200,3200,1:4,40,20) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00340528 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106717 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00354631 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00340528 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,1:8,20,10) -> Float(480,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342335 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00985813 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00503488 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00342335 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,1:8,20,10) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00455743 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117131 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00363189 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00363189 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,1:8,20,10) -> Half(12800,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00337882 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107608 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00314166 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00314166 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,1:8,20,10) -> Half(6400,6400,160:2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326753 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0099392 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00335698 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00326753 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,1:8,20,10) -> Half(800,800,1:16,10,5) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00561829 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010738 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00352256 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00352256 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,1:8,20,10) -> Half(480,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0040047 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106253 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345339 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00345339 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,1:8,20,10) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0039549 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109453 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0046907 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0039549 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,1:8,20,10) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0237505 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109437 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0237525 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0109437 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(800,800,1:16,10,5) -> Float(12800,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033516 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0098947 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0034535 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0033516 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(800,800,1:16,10,5) -> Float(12800,12800,1,160,80) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034203 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103063 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0040184 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0034203 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(800,800,1:16,10,5) -> Float(3200,3200,1:4,40,20) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00328966 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106883 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0035944 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00328966 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(800,800,1:16,10,5) -> Float(480,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342063 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0095613 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00348521 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00342063 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(800,800,1:16,10,5) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00355624 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118041 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00366011 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00355624 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(800,800,1:16,10,5) -> Half(12800,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00634673 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107729 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00352814 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00352814 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(800,800,1:16,10,5) -> Half(6400,6400,160:2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00406463 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00977341 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349781 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00349781 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(800,800,1:16,10,5) -> Half(1600,1600,1:8,20,10) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00346003 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106648 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00357783 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00346003 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(800,800,1:16,10,5) -> Half(480,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00398383 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0132667 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349971 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00349971 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(800,800,1:16,10,5) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00392463 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00989227 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00394119 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00392463 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(800,800,1:16,10,5) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0237192 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106047 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.023778 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0106047 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(480,480,160:32,2,1) -> Float(12800,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.003245 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104937 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00410772 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.003245 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(480,480,160:32,2,1) -> Float(12800,12800,1,160,80) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00337265 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105241 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00350985 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00337265 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(480,480,160:32,2,1) -> Float(3200,3200,1:4,40,20) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00349257 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104216 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00362263 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00349257 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(480,480,160:32,2,1) -> Float(480,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00497214 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108287 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347222 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00347222 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(480,480,160:32,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0043556 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117904 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0036376 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0036376 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(480,480,160:32,2,1) -> Half(12800,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00340833 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109267 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00351721 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00340833 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(480,480,160:32,2,1) -> Half(6400,6400,160:2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00400025 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114187 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0034819 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0034819 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(480,480,160:32,2,1) -> Half(1600,1600,1:8,20,10) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00403982 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105156 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00354631 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00354631 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(480,480,160:32,2,1) -> Half(800,800,1:16,10,5) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00343173 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105691 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00359086 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00343173 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(480,480,160:32,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0042955 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0150263 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00370215 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00370215 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(480,480,160:32,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0234645 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118755 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0234266 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0118755 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(12800,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00324717 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00957775 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00303505 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00303505 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(12800,12800,1,160,80) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0040225 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0139611 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00305819 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00305819 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(3200,3200,1:4,40,20) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00305469 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111406 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00355568 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00305469 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(480,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034585 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118671 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00357185 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0034585 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00411505 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0210207 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0036841 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0036841 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(12800,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00339508 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0136087 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0031511 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0031511 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(6400,6400,160:2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00332832 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117862 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00342313 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00332832 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(1600,1600,1:8,20,10) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00332449 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0168554 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00357174 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00332449 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(800,800,1:16,10,5) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00335426 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118207 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0035549 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00335426 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(480,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.003387 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130735 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00451914 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.003387 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0234051 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0126122 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0234233 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0126122 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(12800,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00373498 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010705 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0039873 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00373498 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(12800,12800,1,160,80) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00395293 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121044 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00418064 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00395293 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(3200,3200,1:4,40,20) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00389078 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112359 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00284692 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00284692 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(480,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00328914 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0067279 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00325558 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00325558 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00279332 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00693467 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00290514 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00279332 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(12800,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0026483 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111782 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00352045 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0026483 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(6400,6400,160:2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00336649 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118829 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345796 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00336649 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(1600,1600,1:8,20,10) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00471798 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117046 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00311632 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00311632 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(800,800,1:16,10,5) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00373263 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116476 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00357977 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00357977 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(480,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034375 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0129269 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00358469 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0034375 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 634) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0039103 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100974 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00317168 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00317168 [04/18/2023-18:31:31] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(38400,12800,1,160,80) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(38400,12800,1,160,80) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(38400,12800,1,160,80) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00221363 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599962 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00222143 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00221363 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238248 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106168 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239299 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238248 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239939 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605238 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238796 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238796 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238186 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606076 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00303429 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238186 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00185659 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615105 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00209365 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00185659 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235983 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610952 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00192548 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00192548 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237699 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592018 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267208 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237699 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235534 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058805 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236643 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235534 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240282 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608286 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239733 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239733 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249048 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594907 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00210225 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00210225 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00274467 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106524 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00412134 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00274467 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00347048 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106916 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00691722 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00347048 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00312855 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101897 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00387744 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00312855 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00260713 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599124 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238446 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238446 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246763 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00797281 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266464 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00246763 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00195293 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601695 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00197711 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00195293 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237227 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588745 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237602 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237227 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00438636 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605029 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237145 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237145 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237932 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599752 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236328 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236328 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238446 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00696478 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00410762 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238446 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247291 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00778851 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246261 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246261 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246518 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0065201 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246873 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00246518 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00295529 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00663501 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00222523 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00222523 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00223821 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601486 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00224307 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00223821 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239078 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599505 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00288512 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239078 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252183 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0067279 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250223 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250223 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.002329 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605638 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00224693 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00224693 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238644 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109294 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238987 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238644 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237782 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599638 [04/18/2023-18:31:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238895 [04/18/2023-18:31:31] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237782 [04/18/2023-18:31:31] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239215 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596419 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238385 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238385 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00311225 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603352 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240244 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240244 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250643 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0065494 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248875 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248875 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250779 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0132817 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255567 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00250779 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00224886 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00756884 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00225936 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00224886 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.002254 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591031 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00225307 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00225307 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0029246 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606629 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239078 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239078 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251348 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00663751 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251445 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00251348 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0022515 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00841897 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00231019 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0022515 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239436 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00779862 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023901 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0023901 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238789 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00639503 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238583 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238583 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00288485 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598552 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245385 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00245385 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266574 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242503 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00242503 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252672 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0124427 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250819 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250819 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00276721 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00676343 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250089 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250089 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00224043 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602362 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00225457 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00224043 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0028704 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0068578 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232686 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00232686 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253883 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00674764 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249679 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249679 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00258033 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00863301 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252142 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252142 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0022405 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611028 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00224986 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0022405 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024774 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00660945 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248741 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0024774 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251116 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00653091 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251701 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00251116 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249813 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00651345 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271707 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00249813 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0037754 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0065706 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250246 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250246 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239352 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614305 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237767 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237767 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239253 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600838 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00289125 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239253 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00187809 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618991 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0020465 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00187809 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00223729 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601429 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00223128 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00223128 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238037 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608743 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239002 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238037 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240236 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613886 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241143 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00240236 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238301 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00627896 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244014 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238301 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241562 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00623324 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00192439 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00192439 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234447 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615352 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00213042 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00213042 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237699 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00635766 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234319 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234319 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236808 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629128 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238164 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236808 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235316 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00624417 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00207914 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00207914 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00321361 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00624378 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023405 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0023405 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00225129 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604057 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00189486 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00189486 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00225707 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059317 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00225214 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00225214 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240107 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600686 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239314 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239314 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00243533 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606038 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244998 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00243533 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253458 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00657226 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00258351 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00253458 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00222143 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619486 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00190781 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00190781 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00288933 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101114 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00262575 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00262575 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00308562 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010133 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234754 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234754 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238514 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613924 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237999 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237999 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247519 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0066801 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246408 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246408 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00244308 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00681538 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244052 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00244052 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00224171 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593189 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00200013 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00200013 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00225257 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600952 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0022385 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0022385 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239916 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612495 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239322 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239322 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00243278 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603257 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243479 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00243278 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250675 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00658722 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250899 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00250675 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.002244 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611529 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00198406 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00198406 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242332 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612438 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00319969 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00242332 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00387113 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104614 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00407098 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00387113 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00357737 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100416 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00318486 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00318486 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00305177 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113811 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00312229 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00305177 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00307122 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110277 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00329652 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00307122 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0029551 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100937 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283061 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00283061 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00225736 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585399 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00228257 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00225736 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240023 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603505 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238743 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238743 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249466 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00583369 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024375 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0024375 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251116 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00644214 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0030471 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00251116 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00221278 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0061981 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00223121 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00221278 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240716 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615314 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236208 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236208 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248126 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00642604 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234544 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234544 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240952 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609238 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237519 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237519 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00244827 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00683886 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246214 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00244827 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248568 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00679501 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243549 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00243549 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00227534 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608819 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00226843 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00226843 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00226429 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600705 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00226029 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00226029 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239756 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605086 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242232 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239756 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024547 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610952 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245199 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00245199 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025256 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0066346 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252207 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252207 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00232081 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00625292 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00222537 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00222537 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236403 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00632944 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235728 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235728 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236186 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617505 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238758 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236186 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237325 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611352 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237992 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237325 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248307 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00671314 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248237 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248237 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247039 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00685562 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246897 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246897 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00225336 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596248 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00196578 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00196578 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233416 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00654753 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00231978 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00231978 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250859 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00661964 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251437 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00250859 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253193 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00660135 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253273 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00253193 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236823 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618381 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238007 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236823 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00221468 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617447 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00195039 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00195039 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024258 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00662088 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242034 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00242034 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246668 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00669049 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245432 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00245432 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00245277 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00670774 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246715 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00245277 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246237 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00701801 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250491 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00246237 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234964 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607962 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236096 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234964 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00224586 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606114 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00225036 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00224586 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023332 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00659304 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233091 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00233091 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251974 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00662462 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252255 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00251974 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025199 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00674161 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00256377 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0025199 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238202 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615162 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241372 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238202 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0022163 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00622688 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00223986 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0022163 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024016 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00681861 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244083 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0024016 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246067 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00669818 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245943 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00245943 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00245098 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00669714 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245207 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00245098 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246644 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00687478 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024616 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0024616 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 639) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235271 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00620571 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244114 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235271 [04/18/2023-18:31:32] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00313222 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106064 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00316442 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00313222 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00286418 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0164389 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00308795 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00286418 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0029204 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0164485 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00298752 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0029204 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00497324 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.016413 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0049518 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0049518 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0031511 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617295 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00320355 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0031511 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0031686 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00710182 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00319543 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0031686 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00291291 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.007152 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00291881 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00291291 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00290377 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00714166 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00292254 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00290377 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00291946 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00713818 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00291974 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00291946 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00401651 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00771513 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00393538 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00393538 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00341148 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00742789 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00382677 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00341148 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00378863 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111666 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00393402 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00378863 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00379008 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0156731 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00400025 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00379008 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00528637 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0163693 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0052671 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0052671 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00381041 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107445 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0040896 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00381041 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00371517 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109084 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00379802 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00371517 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00400267 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112155 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0041681 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00400267 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0036684 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110126 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00387818 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0036684 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00385781 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110354 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00307482 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00307482 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00437541 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00738674 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00437929 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00437541 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00347918 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060419 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347538 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00347538 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266802 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0157115 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267463 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266802 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270241 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0156677 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0027219 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00270241 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00529896 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0163616 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00529422 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00529422 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.003472 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608552 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0034621 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0034621 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00350863 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00738286 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00348376 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00348376 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266912 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0067333 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270689 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266912 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268783 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673268 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00272397 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00268783 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271094 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673912 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269325 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00269325 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00439508 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00737326 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00439605 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00439508 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00332239 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00331439 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00331439 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266912 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0163606 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268605 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266912 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269792 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0163515 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00276519 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00269792 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00577134 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0163779 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00577646 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00577134 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00330421 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605029 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00330732 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00330421 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00337956 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.007376 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00338892 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00337956 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269887 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00737326 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00285239 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00269887 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271293 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00741783 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026924 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0026924 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269113 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00737783 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271474 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00269113 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00439674 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00739931 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00433053 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00433053 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00319563 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0204591 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00318821 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00318821 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00316124 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121691 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00315101 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00315101 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00315975 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121375 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00318435 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00315975 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0051982 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121196 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00513159 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00513159 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325953 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0393131 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00322804 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00322804 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00339859 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00675325 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00338828 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00338828 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00315677 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0068689 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00316561 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00315677 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00316581 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00676634 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00317019 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00316581 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00316462 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673683 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00315538 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00315538 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0042322 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00676696 [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0042326 [04/18/2023-18:31:32] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0042322 [04/18/2023-18:31:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:32] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:32] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:32] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00314763 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630817 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00315399 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00314763 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00286555 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603238 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00287515 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00286555 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00293616 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608762 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00294726 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00293616 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00548114 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603257 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00549621 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00548114 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00308941 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00652966 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0030969 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00308941 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00316233 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.014619 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00315796 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00315796 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00289701 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0145746 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00289417 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00289417 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0028704 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0145742 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00288009 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0028704 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00290313 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0145792 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00286738 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00286738 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00392377 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0170489 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00392463 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00392377 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00316442 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00707374 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00316094 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00316094 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00272647 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00736091 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271664 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00271664 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00279622 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00736526 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00279297 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00279297 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00549837 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00736526 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00562268 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00549837 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00312169 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00646619 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00313759 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00312169 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269999 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00735611 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269096 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00269096 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00273527 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00740983 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271784 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00271784 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00272224 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00741486 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00273656 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00272224 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271853 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00743474 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271897 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00271853 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00320254 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00743634 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00319868 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00319868 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00349157 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00709246 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00348945 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00348945 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267649 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00667678 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267293 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00267293 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271043 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00680773 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270085 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00270085 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0057324 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00733143 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00562796 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00562796 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00338956 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00622489 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00338509 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00338509 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0035808 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00765522 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00350517 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00350517 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268402 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00677382 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267623 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00267623 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266083 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00863166 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00275798 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266083 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266726 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00676862 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00265642 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00265642 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00435726 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00745531 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00434895 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00434895 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00349369 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00710378 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00348071 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00348071 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267767 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00823619 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00275968 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00267767 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268902 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00669236 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00278787 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00268902 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00586917 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00738469 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00566822 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00566822 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00343107 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00631891 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00340147 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00340147 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00348103 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00742606 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00348655 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00348103 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268936 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00716434 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266455 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00266455 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267877 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00677818 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267683 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00267683 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0026604 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00857197 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00278145 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0026604 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0043538 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00745623 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00436571 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0043538 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00333087 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00870293 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.003355 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00333087 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266989 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00794844 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268114 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266989 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270292 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00880838 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270655 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00270292 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00527624 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00836343 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00526922 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00526922 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00321818 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00638291 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00320813 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00320813 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00289024 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00965455 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00284451 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00284451 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267344 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0074256 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026764 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00267344 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266904 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00784553 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026759 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266904 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269105 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00745143 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266726 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00266726 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00332396 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00779501 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0033314 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00332396 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00320609 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0290313 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00320742 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00320609 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00315737 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00783481 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00321097 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00315737 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00318314 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00694248 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00315339 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00315339 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00511918 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00677714 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00512996 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00511918 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00323962 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0611474 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00320284 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00320284 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00331501 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116244 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00387089 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00331501 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00534278 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0163139 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00455757 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00455757 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00398197 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0128488 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00437763 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00398197 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00381762 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0126651 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00417071 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00381762 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00429418 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0132642 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00439716 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00429418 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00378803 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0289435 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00379537 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00378803 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00388199 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0146117 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00390647 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00388199 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00581672 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.015445 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00394057 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00394057 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0057355 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012645 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00569037 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00569037 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00415295 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0612114 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00395219 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00395219 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00806514 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0129036 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0042798 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0042798 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00438677 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0127265 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00454829 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00438677 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00384565 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0154025 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00428047 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00384565 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00644114 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0131948 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00434438 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00434438 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Add_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00430588 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0132783 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00440256 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00430588 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00370262 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115488 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00379128 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00370262 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00471535 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0163647 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00416235 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00416235 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00372782 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0163723 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00433828 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00372782 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00553934 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0164003 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0055302 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0055302 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00381089 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117124 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00413309 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00381089 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00377901 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111518 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00391969 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00377901 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00433967 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0132023 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00407784 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00407784 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00639424 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110404 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00409692 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00409692 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00413584 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011117 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00428356 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00413584 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,160,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00418338 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0135456 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00429136 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00418338 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00757303 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0143584 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0038998 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0038998 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00364354 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116346 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00380271 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00364354 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00375842 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0156709 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00374881 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00374881 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0058187 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0164043 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00582144 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0058187 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00393328 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110164 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00398146 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00393328 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00407809 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130549 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0040973 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00407809 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00649333 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117651 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00422386 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00422386 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00366354 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110632 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00428719 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00366354 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00421593 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109061 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00435477 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00421593 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(38400,12800,1,160,80) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00437915 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111226 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00435048 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00435048 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00386286 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111437 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0041711 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00386286 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0036608 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0156667 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00377061 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0036608 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00692092 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0156526 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0041216 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0041216 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00578048 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0163865 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00585911 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00578048 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00398959 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0127006 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00508218 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00398959 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00406489 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110337 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00431274 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00406489 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00443719 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114848 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00429822 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00429822 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00416927 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0134242 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00424121 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00416927 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00418482 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112148 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00400051 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00400051 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1:4,40,20) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0043768 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110818 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0044027 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0043768 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00463764 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113428 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00565574 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00463764 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00376421 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.016416 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00420302 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00376421 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00365417 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0163677 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00436502 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00365417 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00544914 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0163515 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00544203 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00544203 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00416705 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111828 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00413518 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00413518 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00387744 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111121 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00429997 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00387744 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00406756 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0152029 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00440547 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00406756 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00421499 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108193 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00373111 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00373111 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00422454 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108598 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00433773 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00422454 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(1440,480,160:32,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00436336 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117025 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00436544 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00436336 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00376048 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0204114 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00405206 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00376048 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00412748 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0128377 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00521469 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00412748 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00417006 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0150615 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00386274 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00386274 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00510302 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0129154 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00540851 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00510302 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325267 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.039336 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00402844 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00325267 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00416901 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0068406 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00338998 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00338998 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00314932 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00689524 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00431435 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00314932 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00381089 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0220728 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00542544 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00381089 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00425492 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0122427 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00412225 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00412225 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Float(12800,1:4,160,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00432202 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0125806 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00440755 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00432202 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038542 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119733 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00558259 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0038542 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00376313 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113477 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00384277 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00376313 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00403594 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011354 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00410384 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00403594 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00485333 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0144073 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00487406 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00485333 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00427657 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115323 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00393859 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00393859 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00425102 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0146053 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00520774 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00425102 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00392278 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0191069 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00425896 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00392278 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00395713 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0145893 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00430454 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00395713 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00425519 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0146309 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00432834 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00425519 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(38400,12800,160,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00503522 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0170443 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00440464 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00440464 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00371341 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111153 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00374283 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00371341 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00365097 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110927 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00377961 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00365097 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00398514 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0195446 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00427106 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00398514 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00493636 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111195 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00494235 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00493636 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00415295 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110495 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00422938 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00415295 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00428303 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102906 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0043617 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00428303 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00435713 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114142 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00451657 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00435713 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0037665 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111852 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00516506 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0037665 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0048832 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0168254 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00429768 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00429768 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(19200,6400,160:2,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00422091 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112232 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00439661 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00422091 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00393019 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110917 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00511869 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00393019 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00361589 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0136594 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00420362 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00361589 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00414459 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113677 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00419957 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00414459 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00534197 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110949 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00535416 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00534197 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.004524 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604838 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00338679 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00338679 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00351509 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00741257 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349112 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00349112 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00331439 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0153015 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267657 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00267657 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0026527 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00676821 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268275 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0026527 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266921 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00676738 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268749 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266921 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,1:8,20,10) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00429351 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00743909 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00431933 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00429351 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00349358 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0071249 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347646 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00347646 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00450443 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00669693 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267293 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00267293 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270016 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00672457 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268588 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00268588 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00528996 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00739657 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00529354 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00528996 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00338966 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060499 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00337371 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00337371 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00349246 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00840736 [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00348733 [04/18/2023-18:31:33] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00348733 [04/18/2023-18:31:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:33] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:33] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:33] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267767 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00753486 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00285024 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00267767 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267319 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00821156 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271414 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00267319 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00349458 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00675553 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271224 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00271224 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,1:16,10,5) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00429284 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00744594 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00427133 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00427133 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00335543 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00710661 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00436876 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00335543 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270758 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00792926 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266624 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00266624 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00275156 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00872228 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00276378 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00275156 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00541054 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00833168 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0054163 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00541054 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00321351 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629824 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00321646 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00321351 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00346612 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00955672 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00285105 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00285105 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267733 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00745783 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269613 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00267733 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0027068 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00752048 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0128143 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0027068 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00300581 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00743634 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269198 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00269198 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(1440,480,160:32,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00334129 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00744571 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00524196 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00334129 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00530452 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0288933 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00426151 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00426151 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00376529 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117925 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00428571 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00376529 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00375818 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119669 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00435837 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00375818 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00515249 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119467 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00512245 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00512245 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00374717 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0611352 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00401917 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00374717 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00413584 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0123817 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00414824 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00413584 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00577371 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0127421 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00452171 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00452171 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00376205 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012629 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00426729 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00376205 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0037689 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0151621 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00387064 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0037689 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,160,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00541748 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0132056 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00433441 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00433441 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00377853 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0289307 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00411585 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00377853 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038657 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116839 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0039103 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0038657 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00533384 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011973 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00394415 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00394415 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00555253 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012659 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00554637 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00554637 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00414054 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.061245 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0042326 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00414054 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00530861 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0125806 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00427415 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00427415 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00397346 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0129352 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00401905 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00397346 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00383759 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0126678 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00512506 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00383759 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00406527 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0127158 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00396318 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00396318 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(12800,12800:32,160,2,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Mul_1_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00432444 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0132069 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00433233 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00432444 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0262537 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0243078 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0263771 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0243078 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0265539 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0243048 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0265821 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0243048 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.11008 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.025456 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.110007 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.025456 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0241775 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.017342 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.024109 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.017342 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0241295 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0174268 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0240884 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0174268 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,6800,85,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0637318 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0184977 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0641707 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0184977 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0229695 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0239101 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0228473 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0228473 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.130341 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0257737 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.13056 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0257737 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0201309 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0177488 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0202411 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0177488 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0201509 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0175903 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0201697 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0175903 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(1632000,544000,1,6800,80) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0833829 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0179914 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0833257 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0179914 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.022878 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0238217 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0229512 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.022878 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.12917 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0256945 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.129536 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0256945 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0227951 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0176335 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.022816 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0176335 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0226952 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0175583 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0227507 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0175583 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1:4,1700,20) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.082944 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.021439 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.082784 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.021439 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0231758 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0236526 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0231549 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0231549 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0238933 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.023712 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0240975 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.023712 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.022946 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0214367 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0229042 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0214367 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0228996 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.017699 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0228624 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.017699 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(61200,20400,6800:32,85,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0790674 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0181634 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0791931 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0181634 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0245295 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0183731 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0247573 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0183731 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0251611 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0184291 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0252587 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0184291 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.110519 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0205897 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.110347 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0205897 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0216901 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0369234 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0216882 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0216882 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.021696 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120267 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0217417 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0120267 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(1632000,544000,6800,85,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0631101 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0138976 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0635368 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0138976 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0227579 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0186731 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0226828 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0186731 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0241067 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0186749 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0241067 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0186749 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.111397 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.020849 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.111616 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.020849 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0219207 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0158647 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0220056 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0158647 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0219912 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.015872 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0219141 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.015872 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(816000,272000,6800:2,85,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0427691 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0157093 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0427851 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0157093 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0207491 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0185943 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0208189 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0185943 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0233006 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.018536 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0233051 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.018536 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.127707 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.020704 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.127781 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.020704 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0215896 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0149952 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0216085 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0149952 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,1:4,1700,20) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0800389 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0150629 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0800183 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0150629 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0207726 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0185926 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0208183 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0185926 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0234005 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0186331 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.023343 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0186331 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.127808 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0207935 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.126441 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0207935 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0215001 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0148814 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0214661 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0148814 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0214596 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0147808 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.021376 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0147808 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,1:8,850,10) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0795063 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0148059 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0794331 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0148059 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0206276 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0188314 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0206713 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0188314 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.023166 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.018596 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0232176 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.018596 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.126386 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0206864 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.12661 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0206864 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0215079 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0146551 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0214224 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0146551 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:16,425,5) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.07936 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.018548 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0794331 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.018548 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0210358 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0182309 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0210632 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0182309 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0232725 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0180423 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.023279 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0180423 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.118272 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0215647 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.118057 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0215647 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0217515 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0148064 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0216882 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0148064 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(61200,20400,6800:32,85,1) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0216849 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0147845 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0217411 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0147845 [04/18/2023-18:31:34] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(1632000,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1_copy_output (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0218011 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0234821 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.02211 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0218011 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(1,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1_copy_output (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0218599 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0223425 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0218593 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0218593 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(1:4,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1_copy_output (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0497813 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.651995 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0519802 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0497813 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(1632000:32,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1_copy_output (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.087424 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.656379 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0887817 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.087424 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(1632000,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1_copy_output (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0216418 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0506057 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0216046 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0216046 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(1632000:2,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1_copy_output (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.023441 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.217673 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0238202 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.023441 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(1:4,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1_copy_output (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.033643 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.218697 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0334802 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0334802 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(1:8,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1_copy_output (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0498499 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.219191 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0508587 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0498499 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(1:16,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1_copy_output (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0874057 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.22133 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0871863 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0871863 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(1632000:32,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1_copy_output (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0872594 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.222647 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0879909 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0872594 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) long-strided -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) long-strided -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) long-strided -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) long-strided -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) long-strided -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) long-strided -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.63/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0181577 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0489143 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0164846 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0164846 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.63/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0135946 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.035147 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00924886 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00924886 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.63/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0115988 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0303342 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00990202 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00990202 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.63/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0138057 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0194743 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00800152 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00800152 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.63/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00753083 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0158016 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00647076 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00647076 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.63/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00669465 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0166898 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00567789 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00567789 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.63/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00930958 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0125585 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00553125 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00553125 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.63/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00508658 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118302 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00371845 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00371845 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.63/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00567736 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114933 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00440201 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00440201 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.62/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00523458 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112615 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00431758 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00431758 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.62/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00441545 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111001 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346449 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00346449 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.62/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00557732 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113832 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00542764 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00542764 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.62/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00543086 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111153 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00445645 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00445645 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.62/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00393872 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113653 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0038157 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0038157 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(25600,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.62/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00547318 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111589 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00356527 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00356527 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.62/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00636462 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00627419 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00447557 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00447557 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.62/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00340941 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00672873 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00281618 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00281618 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(3200,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.62/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00559842 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00901324 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243812 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00243812 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(204800,400,20,1) long-strided -> Float(6400,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(204800,400,20,1) long-strided -> Half(6400,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(6400,400:32,20,1) long-strided -> Float(204800,400,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(6400,400:32,20,1) long-strided -> Half(6400,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(6400,400:32,20,1) long-strided -> Float(204800,400,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(6400,400:32,20,1) long-strided -> Float(6400,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Float(204800,400,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Float(6400,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(102400,400,20,1) -> Half(6400,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Float(204800,400,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Float(6400,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(6400,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Float(204800,400,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Float(6400,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Half(6400,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(204800,1600,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(6400,1600:32,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(204800,400,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.68/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00294531 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.102619 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00294241 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00294241 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(204800,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.68/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.004477 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601314 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266988 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00266988 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(204800,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.68/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00754189 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608057 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00753444 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00608057 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(6400,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.68/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00543289 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617105 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00545185 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00543289 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(6400,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.68/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00602648 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00813536 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00592896 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00592896 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(6400,400:32,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.68/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00922286 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00640696 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.009334 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00640696 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(6400,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.68/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00589422 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00893229 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00604705 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00589422 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(6400,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.68/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00448243 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011354 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.004576 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00448243 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(6400,400:32,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.68/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00560985 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112672 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00560598 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00560598 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(204800,400,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.69/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00386644 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.102565 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00424618 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00386644 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(204800,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.69/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00477303 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110287 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00402044 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00402044 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(204800,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.69/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0075232 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111726 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00754045 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0075232 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(6400,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.69/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00555393 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0131686 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00573897 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00555393 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(6400,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.69/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00589147 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113512 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00593244 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00589147 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(6400,400:32,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.69/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.009202 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112204 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.009248 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.009202 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(6400,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.69/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00591543 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130485 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00597657 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00591543 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(6400,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.69/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00439176 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113055 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00444149 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00439176 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Half(6400,400:32,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: /model.69/conv/_input_quantizer/QuantizeLinear (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0056102 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113691 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00558734 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00558734 [04/18/2023-18:31:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:34] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(409600,1600,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(102400,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(12800,1600:32,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) long-strided -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00408555 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130568 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349023 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00349023 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) long-strided -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00442002 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011449 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00461257 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00442002 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) long-strided -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00404305 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114251 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0039507 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0039507 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) long-strided -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00538836 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114697 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0065041 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00538836 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) long-strided -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00435422 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112988 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00446886 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00435422 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) long-strided -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00440561 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111564 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00361783 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00361783 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00381714 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.022464 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00542222 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00381714 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00408594 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01145 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347342 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00347342 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00439287 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112844 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00459014 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00439287 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00417045 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0126933 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00529456 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00417045 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00391858 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112552 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00355289 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00355289 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00446714 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113389 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00355802 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00355802 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00439979 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0128263 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00460457 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00439979 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00716754 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112636 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00415699 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00415699 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.72/Concat_/model.68/act/LeakyRelu_output_0_clone_3) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.004465 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111075 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00364377 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00364377 [04/18/2023-18:31:34] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(12800,400:4,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.70/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00416771 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0135314 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00342999 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00342999 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.70/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00450614 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114662 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00456943 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00450614 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.70/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0043161 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110681 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00395589 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00395589 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.70/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00448443 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118344 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00410344 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00410344 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.70/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00543746 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113909 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00458314 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00458314 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(12800,400:4,20,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.70/conv/_input_quantizer/QuantizeLinear_output_0) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00429714 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110674 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00359829 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00359829 [04/18/2023-18:31:34] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0099837 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112763 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0100136 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0099837 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0113649 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113002 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0113495 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0113002 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0179006 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011252 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0179229 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.011252 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Float(1:4,1600,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0244532 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0200749 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0240907 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0200749 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00446972 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0138261 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00664769 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00446972 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00601829 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011321 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0041506 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0041506 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0104307 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111121 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00448929 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00448929 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0104281 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110615 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0104669 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0104281 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0134296 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114233 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0134408 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0114233 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Half(1:8,1600,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0328055 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0199646 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0151109 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0151109 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Half(408000:32,1600,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.882834 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0801646 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.763319 [04/18/2023-18:31:34] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0801646 [04/18/2023-18:31:34] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Float(408000,1600,40,1) *************** [04/18/2023-18:31:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00872551 [04/18/2023-18:31:34] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0128427 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00870534 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00870534 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00703521 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114008 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00704762 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00703521 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0225822 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112506 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0226527 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0112506 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Float(1:4,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0427886 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0269714 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0426789 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0269714 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Half(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00843321 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113695 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00842434 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00842434 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00897086 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011309 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00893686 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00893686 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00655397 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.013487 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00657351 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00655397 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Half(25600,1:16,640,16) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00654608 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113568 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00652842 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00652842 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0184731 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108862 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0184503 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0108862 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Half(1:8,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0496884 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0209816 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0497493 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0209816 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Half(408000:32,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.753518 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0715337 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.772242 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0715337 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Float(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00841761 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011309 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0084281 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00841761 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Float(408000,1,10200,255) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00621615 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115538 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00621734 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00621615 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0225907 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112939 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0226325 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0112939 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Float(1:4,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0429417 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0216039 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0431543 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0216039 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00832432 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114222 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0083101 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0083101 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00884383 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112271 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00878037 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00878037 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00726057 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613105 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00728526 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00613105 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(25600,1:16,640,16) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00727109 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612571 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00726057 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00612571 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0181229 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605714 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.018084 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00605714 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(1:8,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.050016 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0209842 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.050176 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0209842 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(408000:32,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.760539 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0715314 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.773271 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0715314 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00828825 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00761985 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00816991 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00761985 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00629764 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00841519 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00629983 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00629764 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00782917 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00763693 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00777143 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00763693 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Float(1:4,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0422091 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0219435 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0422377 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0219435 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00821689 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00711641 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00823238 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00711641 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00861015 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00793215 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00856659 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00793215 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00725828 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595562 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00726971 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00595562 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00728206 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594469 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00728983 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00594469 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0173486 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597581 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0173029 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00597581 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(1:8,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.049152 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.020928 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0493958 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.020928 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(408000:32,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.776338 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0714354 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.752978 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0714354 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0144133 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.166473 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0145998 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0144133 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0147758 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.166473 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0147419 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0147419 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0155127 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.166473 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0157902 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0155127 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0193034 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.166619 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0195703 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0193034 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0134196 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0861623 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0155419 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0134196 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0196531 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0801646 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.014149 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.014149 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0140438 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0795794 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0145024 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0140438 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0139744 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0797257 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.014016 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0139744 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0151461 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0795794 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0151438 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0151438 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Half(1:8,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0408823 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0871131 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0410331 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0408823 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Half(408000:32,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.774583 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0756594 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.77403 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0756594 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00917657 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0339081 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00983771 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00917657 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0106292 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0325138 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0112014 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0106292 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0114947 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0331209 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0115263 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0114947 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0180114 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0206975 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0179783 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0179783 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Float(1:4,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.02179 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0806766 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0220167 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.02179 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00582199 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619181 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00418207 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00418207 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0100596 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616152 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00421069 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00421069 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0100657 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062396 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0100523 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0062396 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0134225 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621873 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.013418 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00621873 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Half(1:8,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0316215 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0195291 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0146715 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0146715 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Half(408000:32,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.758491 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0552091 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.742254 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0552091 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00613333 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0065359 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00407086 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00407086 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00704065 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00779934 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00702955 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00702955 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00845741 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00639742 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00846118 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00639742 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0183017 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00633719 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0183726 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00633719 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Float(1:4,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0417714 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0816251 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0417394 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0417394 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00582327 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0141544 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0040499 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0040499 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00766917 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00772451 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00341878 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00341878 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00763958 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00640417 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0076403 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00640417 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0134184 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00645883 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0134259 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00645883 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Half(1:8,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0484206 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.023761 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0484693 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.023761 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Half(408000:32,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.757467 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.057344 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.750885 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.057344 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Float(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00815644 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00812216 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00395935 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00395935 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Float(408000,1,10200,255) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00630619 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00908171 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0062881 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0062881 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00779188 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00930743 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00779525 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00779188 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0220513 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00921143 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0220878 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00921143 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Float(1:4,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0416914 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0813326 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0411371 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0411371 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Half(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00789919 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0125676 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00357863 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00357863 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00820495 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00910086 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00341997 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00341997 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Half(25600,1:16,640,16) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00698166 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00944571 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00700495 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00698166 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.017407 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.009174 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0173907 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.009174 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Half(1:8,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0482941 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.021504 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0487619 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.021504 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Half(408000:32,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.752905 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0571002 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.761271 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0571002 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Float(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00817422 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102762 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00813587 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00813587 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Float(408000,1,10200,255) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00628055 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102606 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00629605 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00628055 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00778346 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102041 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00782051 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00778346 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0220473 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00994377 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0220891 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00994377 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Float(1:4,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0420514 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.081392 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0418343 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0418343 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Half(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00789847 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012608 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00792205 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00789847 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00820114 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102818 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00815949 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00815949 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00700038 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104173 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0070622 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00700038 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0173699 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010226 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0174075 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.010226 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Half(1:8,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0480305 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0215478 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0479954 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0215478 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Half(408000:32,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.762295 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0569539 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.747227 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0569539 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00791796 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102037 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00796038 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00791796 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00634693 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100852 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00634395 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00634395 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00789004 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00999771 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00787777 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00787777 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0200634 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010165 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0200857 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.010165 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(1:4,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0414434 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0813463 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0413623 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0413623 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00780656 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012733 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00780632 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00780632 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00789414 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103618 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00791868 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00789414 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0070117 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010274 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00700604 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00700604 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0070424 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103703 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00700604 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00700604 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(1:8,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0485669 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0216353 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0489417 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0216353 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(408000:32,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.736402 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0584655 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.758917 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0584655 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0152832 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0568564 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.014181 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.014181 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0152709 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0583589 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0155072 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0152709 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.015728 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0582156 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0160239 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.015728 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0193994 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0597821 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.022306 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0193994 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Float(1:4,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0331922 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0942149 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0339063 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0331922 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0214753 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.258779 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0217607 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0214753 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0209319 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.253513 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0221068 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0209319 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.013775 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.252635 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0136303 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0136303 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0138838 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.252635 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0136964 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0136964 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0147749 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.2528 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0144069 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0144069 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Half(408000:32,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.779419 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0766537 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.757513 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0766537 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0260861 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0606111 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0244739 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0244739 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0390331 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0628221 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0389131 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0389131 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0390297 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0674789 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0390583 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0390297 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0272579 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0588556 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0271878 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0271878 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Float(1:4,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0425326 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0961829 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.042968 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0425326 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.023281 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.260242 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0231138 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0231138 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0231549 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.256731 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0232993 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0231549 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0381817 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.255707 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.038144 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.038144 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0382023 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.255653 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.038424 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0382023 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0239665 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.256 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.023933 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.023933 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Half(1:8,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.1/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.051072 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0444171 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0511025 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0444171 [04/18/2023-18:31:35] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Half(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0209548 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0427829 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0213564 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0209548 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1600,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Float(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Half(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Half(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0183817 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0349294 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0145093 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0145093 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Half(25600,1:16,640,16) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,1,10200,255) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Float(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Float(408000,1,10200,255) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0129067 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0272968 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0125402 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0125402 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(25600,1:16,640,16) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(102400,1:4,2560,64) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.010016 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0237055 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00867818 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00867818 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(12800,1600:32,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Half(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.013654 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0794469 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0137775 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.013654 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(1:4,1600,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Half(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0100858 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0159843 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0101071 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0100858 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000,1600,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Half(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00756018 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0137874 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00756956 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00756018 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(204800,1600:2,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:4,2560,64) -> Float(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00818921 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0125326 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00819505 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00818921 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:4,2560,64) -> Float(408000,1,10200,255) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00629486 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115305 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00629565 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00629486 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:4,2560,64) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00779862 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115038 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0077683 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0077683 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:4,2560,64) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0220643 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110175 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0221042 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0110175 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:4,2560,64) -> Half(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00790665 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0141232 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00789341 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00789341 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:4,2560,64) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0082146 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116698 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00826464 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0082146 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:4,2560,64) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00701344 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113097 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00700865 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00700865 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:4,2560,64) -> Half(25600,1:16,640,16) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00698318 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114029 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00702455 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00698318 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(102400,1:4,2560,64) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0173516 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00636144 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0173389 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00636144 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Float(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Float(408000,1,10200,255) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Half(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Half(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00716914 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630122 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.007008 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00630122 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Half(25600,1:16,640,16) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(51200,1:8,1280,32) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Float(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Float(408000,1,10200,255) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Half(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Half(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00697927 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00627836 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00699015 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00627836 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:16,640,16) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00699821 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00620571 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00698384 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00620571 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(12800,1600:32,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Half(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0135144 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.252795 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.013701 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0135144 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(1:8,1600,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Float(408000,1,10200,255) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Half(102400,1:4,2560,64) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_1_output_0 -> ) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.038176 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.256119 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.038144 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.038144 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Half(25600,1:16,640,16) *************** [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,1600,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:31:35] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0107948 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0330377 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0110055 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0107948 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0108235 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0326135 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0109469 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0108235 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0536869 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0341486 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0535893 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0341486 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.008982 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0343963 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00997791 [04/18/2023-18:31:35] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.008982 [04/18/2023-18:31:35] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0100578 [04/18/2023-18:31:35] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0326181 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00797359 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00797359 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00724366 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0219429 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00498885 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00498885 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00645148 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0132696 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00396454 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00396454 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00682188 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010977 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00686324 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00682188 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0261364 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00849398 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0263147 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00849398 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00801702 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00918829 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00799771 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00799771 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00619409 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00849963 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00618971 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00618971 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0577341 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00779741 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0576701 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00779741 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00790833 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00724411 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00794311 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00724411 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00848161 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00774183 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00846306 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00774183 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00619467 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673808 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00622788 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00619467 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00620229 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0067493 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00621794 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00620229 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0066481 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00683167 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00664727 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00664727 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0302171 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00640378 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0301989 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00640378 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00838425 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00927286 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00840471 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00838425 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00632964 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109776 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00621162 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00621162 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0575909 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108754 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0577371 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0108754 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00842891 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103736 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00838984 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00838984 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00882474 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101108 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00886561 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00882474 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00702172 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102073 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00702716 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00702172 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00703325 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673517 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00702563 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00673517 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00745371 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673559 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00745188 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00673559 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0302811 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00640934 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0301934 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00640934 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0083106 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00917229 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00831975 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0083106 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00621496 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0084921 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00623245 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00621496 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0070191 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00849317 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00702542 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0070191 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00826743 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00769732 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00826768 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00769732 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00862333 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00766147 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00858918 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00766147 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00701954 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00677153 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00702128 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00677153 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00702193 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673143 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00702542 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00673143 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00747131 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0067306 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00747749 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0067306 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0299538 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00646956 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0298688 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00646956 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.003036 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00631732 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0065947 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.003036 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00587136 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0066988 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00586313 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00586313 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00644194 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006672 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00644949 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00644194 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0557882 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0065839 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0536549 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0065839 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00582766 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626445 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00418142 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00418142 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00612419 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130203 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00404813 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00404813 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00614152 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103109 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00394798 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00394798 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00656291 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113642 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0065681 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00656291 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.026064 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109264 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0260549 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0109264 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00613657 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110055 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0040654 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0040654 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00628949 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102194 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00630479 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00628949 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00704153 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105185 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00706003 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00704153 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0536442 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109006 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0539596 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0109006 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0058496 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0148814 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00405536 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00405536 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00674618 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130211 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00673787 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00673787 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00674244 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111392 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00363943 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00363943 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00718766 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110407 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0071888 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00718766 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0209881 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112893 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.020975 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0112893 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00774304 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111265 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00773486 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00773486 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00627438 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111729 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00630042 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00627438 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00723063 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111859 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00705916 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00705916 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0558903 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103549 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0560792 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0103549 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00762514 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0144347 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00761889 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00761889 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00824102 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109874 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00793956 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00793956 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00672769 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109943 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00670504 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00670504 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.007192 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111388 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0071808 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0071808 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0283611 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00955943 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0283368 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00955943 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00773702 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106998 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00358674 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00358674 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0062875 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108183 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0062877 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0062875 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0071262 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108725 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00709638 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00709638 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0559299 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0400823 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0559299 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0400823 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0119894 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0363666 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.01048 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.01048 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00918857 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0256053 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00689654 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00689654 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00809219 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0183194 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00704653 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00704653 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00772162 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01814 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00718606 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00718606 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.028355 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0147867 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0283718 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0147867 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00778683 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107386 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00775699 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00775699 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00628373 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0167284 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00627518 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00627518 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00708006 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110411 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00704087 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00704087 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.056125 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103497 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0560762 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0103497 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00771128 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.014555 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00762803 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00762803 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00806375 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00774087 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00808076 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00774087 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00670587 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0067468 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0067279 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00670587 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00679771 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.009452 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00671938 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00671938 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0287305 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111761 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0286784 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0111761 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00789149 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110752 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00789269 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00789149 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00637436 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110615 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00629148 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00629148 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00704109 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111265 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00704762 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00704109 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0554423 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103171 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0554758 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0103171 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00791194 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0142874 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00780607 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00780607 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00527575 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111029 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00531098 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00527575 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00673101 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0135115 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00681774 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00673101 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00673268 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110632 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00672249 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00672249 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_1_output_0) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00717532 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111346 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00718949 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00717532 [04/18/2023-18:31:36] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00347254 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109267 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00664042 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00347254 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00601924 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107386 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00413936 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00413936 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00642246 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108242 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00395181 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00395181 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00804419 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0201092 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00802489 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00802489 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00794108 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107925 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00793778 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00793778 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00842487 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106909 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00842111 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00842111 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00622708 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0126461 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00621138 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00621138 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00838349 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107507 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.008368 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.008368 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00835759 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010832 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00835784 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00835759 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00878306 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0131005 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00880215 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00878306 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00700996 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109035 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00700191 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00700191 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0083294 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106824 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0083134 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0083134 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0082654 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130863 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00827632 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0082654 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00856901 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107523 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0085881 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00856901 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00702868 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107824 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00700952 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00700952 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00403619 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0127223 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00665434 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00403619 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00583186 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111297 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00414354 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00414354 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0061301 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109838 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00391697 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00391697 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00621217 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107618 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00406438 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00406438 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00584832 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0149033 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00406616 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00406616 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.006752 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0127177 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00371774 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00371774 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00774689 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108722 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00773534 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00773534 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00763068 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0144078 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00763789 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00763068 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00795378 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0132768 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00799492 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00795378 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00672083 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110639 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00674078 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00672083 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00773462 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107393 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00351654 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00351654 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00762947 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0145353 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00351342 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00351342 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00796394 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107915 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00322976 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00322976 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00777792 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107977 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00777937 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00777792 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00763332 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0145285 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00762851 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00762851 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00806349 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108415 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00804673 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00804673 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00672603 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110389 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00671294 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00671294 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00792782 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109211 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00789871 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00789871 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00784987 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.014267 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00783639 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00783639 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00527184 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109267 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00528457 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00527184 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_1_output_0 -> ) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0068615 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109136 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00673351 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00673351 [04/18/2023-18:31:36] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) long-strided -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00584795 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106155 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00584137 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00584137 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) long-strided -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00634037 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0131848 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00634912 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00634037 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) long-strided -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0513463 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105721 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0512411 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0105721 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) long-strided -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00541139 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110748 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0054146 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00541139 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) long-strided -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00604495 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102668 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00594341 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00594341 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) long-strided -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00633202 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0134641 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0063364 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00633202 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) long-strided -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00633898 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107879 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00635051 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00633898 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) long-strided -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00672519 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108183 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00670317 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00670317 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) long-strided -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0252983 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107128 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0252183 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0107128 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) long-strided -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00553477 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110984 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00553336 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00553336 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) long-strided -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00592256 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108232 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00582437 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00582437 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) long-strided -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00633202 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109525 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00636104 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00633202 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) long-strided -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0513463 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107825 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.05136 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0107825 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) long-strided -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00571095 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110287 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0056851 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0056851 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) long-strided -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00600495 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0126522 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.006 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.006 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) long-strided -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00600857 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0127486 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00608076 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00600857 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) long-strided -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00643299 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113684 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0064157 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0064157 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) long-strided -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.025088 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108229 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0251093 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0108229 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) long-strided -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00606248 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105091 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00610781 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00606248 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) long-strided -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00617905 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010655 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00619619 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00617905 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) long-strided -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0069083 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106237 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00689284 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00689284 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) long-strided -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0512579 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0122472 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.051395 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0122472 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) long-strided -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00568246 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0151991 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00568738 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00568246 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) long-strided -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00659491 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108686 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00658743 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00658743 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) long-strided -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00663584 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106054 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00660842 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00660842 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) long-strided -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00703565 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107556 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00703761 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00703565 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) long-strided -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0202269 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105303 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0202331 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0105303 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) long-strided -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00749166 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110773 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00754141 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00749166 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) long-strided -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00618647 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108506 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00618895 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00618647 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) long-strided -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00689023 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109192 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00691483 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00689023 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) long-strided -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0533333 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106576 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0532831 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0106576 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) long-strided -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00723566 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0146848 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00726766 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00723566 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) long-strided -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0077363 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106299 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00773606 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00773606 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) long-strided -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0066533 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110069 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00656831 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00656831 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) long-strided -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00702128 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109656 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00701257 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00701257 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) long-strided -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0272366 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111427 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0272518 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0111427 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(388800,129600,3240,81,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00552861 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011052 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00540106 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00540106 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(388800,129600,3240,81,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00586094 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107827 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00584942 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00584942 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(388800,129600,3240,81,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00637217 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0127604 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00642842 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00637217 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(388800,129600,3240,81,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0509608 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0411063 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.051005 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0411063 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(388800,129600,3240,81,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0179886 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0597882 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0159812 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0159812 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(388800,129600,3240,81,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0105469 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0428617 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0103562 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0103562 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(388800,129600,3240,81,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00984198 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0241539 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00845015 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00845015 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(388800,129600,3240,81,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00766532 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0180514 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00676468 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00676468 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(388800,129600,3240,81,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00698754 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0158135 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0066932 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0066932 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Float(388800,129600,3240,81,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0251947 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00831213 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0252099 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00831213 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(388800,129600,3240,81,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00553301 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0125798 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0057069 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00553301 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(388800,129600,3240,81,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00585326 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00715497 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0058635 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00585326 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(388800,129600,3240,81,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00635786 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00708071 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00634832 [04/18/2023-18:31:36] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00634832 [04/18/2023-18:31:36] [V] [TRT] *************** Autotuning Reformat: Half(388800,129600,3240,81,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:36] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0511025 [04/18/2023-18:31:36] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0426651 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0529067 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0426651 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(388800,129600,3240,81,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00974872 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0350318 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0109012 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00974872 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(388800,129600,3240,81,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0103367 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0253798 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00752938 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00752938 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(388800,129600,3240,81,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0125623 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.020655 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00604876 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00604876 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(388800,129600,3240,81,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00604667 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0134824 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00611352 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00604667 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(388800,129600,3240,81,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00641451 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0133324 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00668093 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00641451 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(388800,129600,3240,81,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0250537 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00858434 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.025088 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00858434 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,3240:2,81,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00601657 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00876881 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00602171 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00601657 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,3240:2,81,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0062 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00992945 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00621933 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0062 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,3240:2,81,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0069083 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00814044 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00690917 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0069083 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,3240:2,81,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0511878 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00826362 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0513082 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00826362 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,3240:2,81,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0058763 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0152955 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00569618 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00569618 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,3240:2,81,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00374025 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00888847 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00375068 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00374025 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,3240:2,81,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00659616 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00982339 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00680838 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00659616 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,3240:2,81,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00658868 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00822908 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00659429 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00658868 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,3240:2,81,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0070215 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00809575 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00703891 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0070215 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(194400,64800,3240:2,81,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0202057 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0170448 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0201857 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0170448 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1:8,405,5) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00744251 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0143653 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00742994 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00742994 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1:8,405,5) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00620038 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0147346 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00618705 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00618705 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1:8,405,5) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00920143 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0143922 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00695445 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00695445 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1:8,405,5) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0533562 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130122 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.053248 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0130122 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1:8,405,5) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00722057 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0150235 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00722606 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00722057 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1:8,405,5) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00767543 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0140559 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00763428 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00763428 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1:8,405,5) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00658119 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0132102 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0065733 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0065733 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1:8,405,5) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00658639 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0139749 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00670753 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00658639 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1:8,405,5) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00702237 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109336 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00701823 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00701823 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1:8,405,5) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_1_output_2) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0271604 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107497 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.027152 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0107497 [04/18/2023-18:31:37] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(12800,400:4,20,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.70/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00385973 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104353 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00435061 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00385973 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(12800,400:4,20,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.70/conv/_input_quantizer/QuantizeLinear_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00402121 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107416 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00366968 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00366968 [04/18/2023-18:31:37] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(12800,400:4,20,1) *************** [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(12800,400:4,20,1) *************** [04/18/2023-18:31:37] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00390029 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111873 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00407505 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00390029 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00391228 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105874 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00688261 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00391228 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00430292 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108666 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00420193 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00420193 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00398044 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106312 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00414276 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00398044 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00332757 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105162 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00609905 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00332757 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00383038 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107419 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00335883 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00335883 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00382171 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106478 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0032774 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0032774 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00399035 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102013 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0047779 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00399035 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00388312 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107553 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.004064 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00388312 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00387509 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104725 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00333693 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00333693 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00747337 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0127147 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00756571 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00747337 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00382809 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112074 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00398273 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00382809 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00407568 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109985 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00407035 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00407035 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(480,160,80:32,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00422696 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0145079 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00584119 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00422696 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00411024 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121162 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0042037 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00411024 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00394749 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107311 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00415073 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00394749 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00377877 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119604 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0039617 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00377877 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00393711 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107576 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00410018 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00393711 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(720,240,1:16,6,3) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00402692 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108147 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0041566 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00402692 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(480,160,80:32,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00378623 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010558 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00486537 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00378623 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00424228 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121318 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00417606 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00417606 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0074752 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012219 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00748457 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0074752 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00391166 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010511 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00487329 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00391166 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(9600,3200,1,80,40) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00388645 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109525 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00411363 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00388645 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(480,160,80:32,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00418312 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108888 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00418351 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00418312 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00410018 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115703 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0068419 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00410018 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00395663 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110991 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0041152 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00395663 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038678 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010658 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00402946 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0038678 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00396775 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0126564 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00514632 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00396775 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(720,240,1:16,6,3) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00516833 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112893 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00411429 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00411429 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(480,160,80:32,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00385251 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107582 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00405994 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00385251 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00398146 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120453 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00411598 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00398146 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00762418 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0122975 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00746468 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00746468 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00298162 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100029 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00307142 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00298162 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240838 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00744 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00650724 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00240838 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00407492 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109185 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00414537 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00407492 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00405536 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121585 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00419918 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00405536 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00392649 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108216 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00401562 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00392649 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00384565 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105894 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00400584 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00384565 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00387669 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106057 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00399936 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00387669 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00404546 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106684 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00418312 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00404546 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00382256 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106057 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0039873 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00382256 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00394069 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120202 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00395206 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00394069 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00750331 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00798578 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00747177 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00747177 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246715 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600933 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246315 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246315 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266387 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0068591 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266362 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00266362 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00273898 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00683037 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268191 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00268191 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00364811 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00684299 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00364011 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00364011 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247109 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590281 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246214 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246214 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025649 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00670608 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00258376 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0025649 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00273121 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00700038 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270008 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00270008 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270793 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00672353 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271724 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00270793 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00317521 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00655771 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349335 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00317521 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00350562 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00955114 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00359909 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00350562 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00748366 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103716 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00749097 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00748366 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00354587 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0127074 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00309904 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00309904 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00349159 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00966156 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00361509 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00349159 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00354843 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107918 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0036408 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00354843 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0037542 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110034 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00379778 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0037542 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00355155 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106442 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00365634 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00355155 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00345067 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108898 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00306004 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00306004 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00404813 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00925257 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00302943 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00302943 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00358377 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109427 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00367566 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00358377 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00351052 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108761 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00363806 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00351052 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00351889 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120103 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00309515 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00309515 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00748777 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107814 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00747086 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00747086 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00327938 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105825 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002996 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.002996 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00332332 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00942714 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00598095 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00332332 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00354955 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105763 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0035808 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00354955 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00379633 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010384 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00380427 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00379633 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00350027 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0128522 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00439245 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00350027 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00349291 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108131 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0031198 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0031198 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00332864 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102025 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00285732 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00285732 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00349781 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00971337 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0043882 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00349781 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033199 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106149 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00359897 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0033199 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00338094 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111968 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345317 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00338094 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00741417 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111413 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00739383 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00739383 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00324852 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105149 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00302752 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00302752 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(9600,3200,1,80,40) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033482 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103824 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347222 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0033482 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00341235 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106475 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00423516 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00341235 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(480,160,80:32,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00394762 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105584 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00382196 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00382196 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00350238 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118607 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00353561 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00350238 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00337159 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107971 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0030789 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0030789 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00328551 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0098624 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00285365 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00285365 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(720,240,1:16,6,3) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00351855 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107585 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00360629 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00351855 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(480,160,80:32,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033121 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106491 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00413753 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0033121 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00341529 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112679 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00343282 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00341529 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00741234 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114135 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00740388 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00740388 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00336808 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106302 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00430407 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00336808 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(9600,3200,1,80,40) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00410893 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103419 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00352112 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00352112 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034695 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107543 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00352825 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0034695 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(480,160,80:32,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00363086 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105355 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00436087 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00363086 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00446686 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0122255 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00358434 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00358434 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342084 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108235 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00355746 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00342084 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00334554 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107327 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00340789 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00334554 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033987 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0134288 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00351799 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0033987 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(480,160,80:32,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326473 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101641 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0031938 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0031938 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00309048 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115376 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00324862 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00309048 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00739497 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115555 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00746903 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00739497 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00297385 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100687 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00363246 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00297385 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00346395 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00981394 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345937 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00345937 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344163 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110848 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00344185 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00344163 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00376 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100629 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00396948 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00376 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326099 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114191 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00323444 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00323444 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00256596 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00639105 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252126 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252126 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237325 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609352 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002374 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237325 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242202 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00975482 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244633 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00242202 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242294 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611333 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243309 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00242294 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270275 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00707744 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00274875 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00270275 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00739131 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00688501 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00740777 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00688501 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247519 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585948 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0021012 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0021012 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269046 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0066026 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266675 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00266675 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0026902 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00664125 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269999 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0026902 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0036568 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00991892 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0036512 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0036512 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252616 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599848 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251725 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00251725 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241006 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00743497 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267352 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00241006 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254741 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0067786 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255298 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00254741 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267488 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00681099 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266167 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00266167 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268089 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00677839 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268453 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00268089 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00320122 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114535 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00321158 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00320122 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00750126 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00625073 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00751017 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00625073 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00255698 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596152 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255927 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00255698 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271672 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00662005 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271181 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00271181 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271448 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00669465 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271759 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00271448 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00420934 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00883738 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0042322 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00420934 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253594 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600781 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252784 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252784 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00255135 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00652634 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252303 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252303 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00265736 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00701671 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266887 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00265736 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266929 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00701932 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268834 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266929 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271681 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00703325 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271232 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00271232 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00306383 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0069895 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00305332 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00305332 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_1_output_0 -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250972 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060781 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253225 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00250972 [04/18/2023-18:31:37] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,80,2,1) -> Float(3200,3200,1,80,40) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235444 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612857 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238187 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235444 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,80,2,1) -> Float(800,800,1:4,20,10) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023997 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611943 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239962 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239962 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,80,2,1) -> Float(160,160,80:32,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0028333 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600838 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00286501 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0028333 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,80,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236725 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606114 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239444 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236725 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,80,2,1) -> Half(3200,3200,80,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00192439 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00624238 [04/18/2023-18:31:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237939 [04/18/2023-18:31:37] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00192439 [04/18/2023-18:31:37] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,80,2,1) -> Half(1600,1600,80:2,2,1) *************** [04/18/2023-18:31:37] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233917 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609886 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0020216 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0020216 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,80,2,1) -> Half(400,400,1:8,10,5) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241128 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603105 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00224179 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00224179 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,80,2,1) -> Half(240,240,1:16,6,3) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240671 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599124 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240709 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00240671 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,80,2,1) -> Half(160,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247622 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602991 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244757 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00244757 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,80,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241288 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602076 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00224093 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00224093 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,80,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00760758 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618971 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00761961 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00618971 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1,80,40) -> Float(3200,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235608 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00632447 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237317 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235608 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1,80,40) -> Float(800,800,1:4,20,10) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00232892 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006196 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233423 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00232892 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1,80,40) -> Float(160,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00281564 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609486 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283473 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00281564 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1,80,40) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254645 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00681774 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002543 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.002543 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1,80,40) -> Half(3200,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238461 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605314 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023674 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0023674 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1,80,40) -> Half(1600,1600,80:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238712 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603638 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238705 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238705 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1,80,40) -> Half(400,400,1:8,10,5) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233386 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606305 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023402 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00233386 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1,80,40) -> Half(240,240,1:16,6,3) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00255625 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630042 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234252 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234252 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1,80,40) -> Half(160,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00258074 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594524 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00311762 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00258074 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1,80,40) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00265685 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00663626 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00265295 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00265295 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,3200,1,80,40) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00763404 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00680947 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00765233 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00680947 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1:4,20,10) -> Float(3200,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00264071 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107709 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00316482 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00264071 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1:4,20,10) -> Float(3200,3200,1,80,40) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240389 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00767422 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233556 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00233556 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1:4,20,10) -> Float(160,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00283545 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607695 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0028333 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0028333 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1:4,20,10) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254998 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00829994 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254805 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00254805 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1:4,20,10) -> Half(3200,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.002392 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613562 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239124 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239124 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1:4,20,10) -> Half(1600,1600,80:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241867 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594962 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243556 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00241867 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1:4,20,10) -> Half(400,400,1:8,10,5) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235226 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598476 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236852 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235226 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1:4,20,10) -> Half(240,240,1:16,6,3) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235631 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598019 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236358 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235631 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1:4,20,10) -> Half(160,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00262458 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592933 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00260189 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00260189 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1:4,20,10) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00265778 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00660405 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268131 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00265778 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1:4,20,10) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00762298 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00676197 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00763958 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00676197 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(160,160,80:32,2,1) -> Float(3200,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249505 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00634514 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241455 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00241455 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(160,160,80:32,2,1) -> Float(3200,3200,1,80,40) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233305 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619695 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233659 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00233305 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(160,160,80:32,2,1) -> Float(800,800,1:4,20,10) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235833 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062243 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236245 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235833 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(160,160,80:32,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00255935 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00663543 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025898 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00255935 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(160,160,80:32,2,1) -> Half(3200,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240091 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595886 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240114 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00240091 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(160,160,80:32,2,1) -> Half(1600,1600,80:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248055 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600152 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246384 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246384 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(160,160,80:32,2,1) -> Half(400,400,1:8,10,5) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023689 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600191 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234664 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234664 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(160,160,80:32,2,1) -> Half(240,240,1:16,6,3) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237047 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597105 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237055 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237047 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(160,160,80:32,2,1) -> Half(160,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00277952 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104095 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00314544 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00277952 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(160,160,80:32,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00304788 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113836 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0032614 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00304788 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(160,160,80:32,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0076557 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00974415 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.007648 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.007648 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(3200,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234394 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603181 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235788 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234394 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(3200,3200,1,80,40) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025038 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00681448 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248079 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248079 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(800,800,1:4,20,10) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252928 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00681448 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025203 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0025203 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(160,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00284603 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0068382 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00296257 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00284603 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(3200,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00292169 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107167 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00369149 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00292169 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(1600,1600,80:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342879 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116026 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347059 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00342879 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(400,400,1:8,10,5) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00347886 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130394 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00355535 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00347886 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(240,240,1:16,6,3) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034938 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117275 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00365509 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0034938 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(160,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00337924 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117218 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0034819 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00337924 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00336882 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010211 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0034671 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00336882 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00762442 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103138 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00760397 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00760397 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200,80,2,1) -> Float(3200,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00294185 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107778 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00309155 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00294185 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200,80,2,1) -> Float(3200,3200,1,80,40) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00338403 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100955 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349034 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00338403 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200,80,2,1) -> Float(800,800,1:4,20,10) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034142 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00988526 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00358697 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0034142 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200,80,2,1) -> Float(160,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342291 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107536 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00355423 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00342291 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200,80,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344142 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107376 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00377949 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00344142 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200,80,2,1) -> Half(1600,1600,80:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00348956 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105025 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00306081 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00306081 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200,80,2,1) -> Half(400,400,1:8,10,5) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00331273 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106988 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00294717 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00294717 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200,80,2,1) -> Half(240,240,1:16,6,3) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342988 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106694 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00354453 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00342988 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200,80,2,1) -> Half(160,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342171 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106857 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00360457 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00342171 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200,80,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00332428 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103729 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00297171 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00297171 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200,80,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00763428 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104509 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00762009 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00762009 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,80:2,2,1) -> Float(3200,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326161 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103353 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00297952 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00297952 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,80:2,2,1) -> Float(3200,3200,1,80,40) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325881 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104274 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00369032 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00325881 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,80:2,2,1) -> Float(800,800,1:4,20,10) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00333927 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00954667 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346003 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00333927 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,80:2,2,1) -> Float(160,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326151 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106296 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00341888 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00326151 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,80:2,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00337382 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0126827 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0035539 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00337382 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,80:2,2,1) -> Half(3200,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00334958 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107399 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00305323 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00305323 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,80:2,2,1) -> Half(400,400,1:8,10,5) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326545 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100718 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00300019 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00300019 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,80:2,2,1) -> Half(240,240,1:16,6,3) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00348626 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106887 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00357234 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00348626 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,80:2,2,1) -> Half(160,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00343173 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106214 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00344022 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00343173 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,80:2,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00328312 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116684 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00339827 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00328312 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(1600,1600,80:2,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00758857 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115938 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00759386 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00758857 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(400,400,1:8,10,5) -> Float(3200,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00319594 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103468 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00305011 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00305011 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(400,400,1:8,10,5) -> Float(3200,3200,1,80,40) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00324256 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104441 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00343521 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00324256 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(400,400,1:8,10,5) -> Float(800,800,1:4,20,10) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00332917 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104519 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349068 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00332917 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(400,400,1:8,10,5) -> Float(160,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325309 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102322 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00342857 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00325309 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(400,400,1:8,10,5) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00338371 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114539 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345339 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00338371 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(400,400,1:8,10,5) -> Half(3200,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00332534 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103304 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00303571 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00303571 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(400,400,1:8,10,5) -> Half(1600,1600,80:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00320406 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010304 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283787 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00283787 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(400,400,1:8,10,5) -> Half(240,240,1:16,6,3) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00363634 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010736 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00375713 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00363634 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(400,400,1:8,10,5) -> Half(160,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00334373 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010306 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349424 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00334373 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(400,400,1:8,10,5) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00341932 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115566 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00339965 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00339965 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(400,400,1:8,10,5) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00761335 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130498 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00755609 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00755609 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(240,240,1:16,6,3) -> Float(3200,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249695 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616114 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240777 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240777 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(240,240,1:16,6,3) -> Float(3200,3200,1,80,40) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234799 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006108 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234469 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234469 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(240,240,1:16,6,3) -> Float(800,800,1:4,20,10) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235279 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609162 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236103 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235279 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(240,240,1:16,6,3) -> Float(160,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00285401 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600495 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283375 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00283375 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(240,240,1:16,6,3) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00256392 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00669299 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254717 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00254717 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(240,240,1:16,6,3) -> Half(3200,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237834 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00622748 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237707 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237707 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(240,240,1:16,6,3) -> Half(1600,1600,80:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240221 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611867 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238804 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238804 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(240,240,1:16,6,3) -> Half(400,400,1:8,10,5) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233113 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00624119 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233947 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00233113 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(240,240,1:16,6,3) -> Half(160,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250915 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621893 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251196 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00250915 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(240,240,1:16,6,3) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00256816 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00685323 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00258539 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00256816 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(240,240,1:16,6,3) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00759194 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0069686 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00759266 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0069686 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(160,160,80:32,2,1) -> Float(3200,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024061 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601752 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247984 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0024061 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(160,160,80:32,2,1) -> Float(3200,3200,1,80,40) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234327 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607295 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239208 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234327 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(160,160,80:32,2,1) -> Float(800,800,1:4,20,10) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235923 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598305 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237857 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235923 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(160,160,80:32,2,1) -> Float(160,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00302943 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006104 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00288521 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00288521 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(160,160,80:32,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00258343 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673912 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252872 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252872 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(160,160,80:32,2,1) -> Half(3200,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239551 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00677569 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239398 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239398 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(160,160,80:32,2,1) -> Half(1600,1600,80:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235556 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00665392 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247637 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235556 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(160,160,80:32,2,1) -> Half(400,400,1:8,10,5) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00232066 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006096 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0028169 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00232066 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(160,160,80:32,2,1) -> Half(240,240,1:16,6,3) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023329 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611086 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00289975 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0023329 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(160,160,80:32,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00273475 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00842514 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270413 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00270413 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(160,160,80:32,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00758015 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00687521 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0075917 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00687521 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(3200,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00243696 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00723154 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00257029 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00243696 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(3200,3200,1,80,40) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249608 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00699494 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251926 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00249608 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(800,800,1:4,20,10) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254163 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00703565 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00257625 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00254163 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(160,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00284486 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0069366 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00290103 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00284486 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242743 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601333 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00315439 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00242743 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(3200,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236635 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00634435 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00219449 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00219449 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(1600,1600,80:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247385 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00780054 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240869 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240869 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(400,400,1:8,10,5) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254035 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00815619 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00257909 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00254035 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(240,240,1:16,6,3) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251637 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121387 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00377203 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00251637 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(160,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00351086 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011992 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00353974 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00351086 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00761335 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106736 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00762225 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00761335 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(3200,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00336 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00915057 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00344936 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00336 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(3200,3200,1,80,40) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00351911 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117704 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00366514 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00351911 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(800,800,1:4,20,10) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00351766 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117908 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00371657 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00351766 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(160,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00345654 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113955 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0035728 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00345654 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00354029 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00993981 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00366945 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00354029 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(3200,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00380126 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104813 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00320193 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00320193 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(1600,1600,80:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00299667 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115524 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00310917 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00299667 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(400,400,1:8,10,5) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0030179 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00703956 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025288 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0025288 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(240,240,1:16,6,3) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025889 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673662 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250483 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250483 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(160,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266404 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00680062 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026792 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266404 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 662) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00256384 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609448 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255388 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00255388 [04/18/2023-18:31:38] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(480,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(720,240,1:16,6,3) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(480,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(9600,3200,1,80,40) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(480,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(720,240,1:16,6,3) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(480,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(9600,3200,1,80,40) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(480,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(720,240,1:16,6,3) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(480,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(9600,3200,1,80,40) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(480,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(480,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:38] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00256751 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00699167 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254709 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00254709 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025292 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00659927 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251894 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00251894 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00255437 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00660904 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254035 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00254035 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00435338 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00661382 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00435879 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00435338 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254805 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626445 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00256555 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00254805 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025994 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598762 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00258743 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00258743 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254701 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602591 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255461 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00254701 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025357 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596438 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254877 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0025357 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00255861 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586843 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255853 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00255853 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00298714 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00580571 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0029663 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0029663 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00260455 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00585271 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00260846 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00260455 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239764 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00637515 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239131 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239131 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241684 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00638907 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241455 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00241455 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00442819 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00662525 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00444107 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00442819 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00273604 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100056 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00323616 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00273604 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00295491 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100632 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00304238 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00295491 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00301724 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102887 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00311364 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00301724 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00295566 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102694 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00303562 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00295566 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00305401 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010155 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00314087 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00305401 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0030508 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103376 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00341867 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0030508 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00324852 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105234 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00333693 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00324852 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00333023 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010511 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00344468 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00333023 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00338764 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108137 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00352736 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00338764 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00441697 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102553 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00455529 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00441697 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00332853 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105825 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00343467 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00332853 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00330088 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0126358 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00412251 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00330088 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00339062 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010736 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349179 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00339062 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00329943 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01053 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00339285 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00329943 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00421405 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00986728 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00353115 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00353115 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00333417 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104882 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00344218 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00333417 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00315906 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104173 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00331906 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00315906 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325226 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104304 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00336914 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00325226 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00335033 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103647 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346068 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00335033 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00364697 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103696 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00363211 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00363211 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326442 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102092 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00336447 [04/18/2023-18:31:38] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00326442 [04/18/2023-18:31:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:38] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:38] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326068 [04/18/2023-18:31:38] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103651 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00339317 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00326068 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033668 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103017 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345818 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0033668 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326203 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0095997 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00336712 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00326203 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034031 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104506 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00352279 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0034031 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00328488 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104343 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00340974 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00328488 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00322844 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010305 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334746 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00322844 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00337169 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117067 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00352424 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00337169 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00338158 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117908 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00343771 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00338158 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00373087 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108878 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00371434 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00371434 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00331532 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119341 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00340158 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00331532 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00334225 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107513 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00343837 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00334225 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00339742 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119345 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00351142 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00339742 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00331917 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011872 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00343478 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00331917 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00347679 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108366 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00362023 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00347679 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00345807 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109915 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00351755 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00345807 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033348 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107892 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00344914 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0033348 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00335883 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104869 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345045 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00335883 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342727 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00993006 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346308 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00342727 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00376265 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105287 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00406045 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00376265 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00307628 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105358 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00324997 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00307628 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00301371 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010094 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00310157 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00301371 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00304486 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102524 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00327418 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00304486 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00296592 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100879 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00306966 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00296592 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00302914 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102054 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00317118 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00302914 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00302428 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00771441 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00326732 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00302428 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00413963 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112334 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00380427 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00380427 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00368586 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104882 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00383483 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00368586 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00373568 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105763 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00392661 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00373568 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00382941 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105156 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00381738 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00381738 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00370192 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107589 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00384517 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00370192 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0035936 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105404 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00389066 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0035936 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00378129 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010655 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00388794 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00378129 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00358332 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106142 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00382544 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00358332 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038566 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105316 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00399213 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0038566 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00382665 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0134786 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00450314 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00382665 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0035675 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104927 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00379693 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0035675 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00361806 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106403 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00384048 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00361806 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00377829 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01067 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00440007 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00377829 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00390536 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104402 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00389337 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00389337 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00363497 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106971 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00387076 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00363497 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00363086 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0141402 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0037045 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00363086 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00383002 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107886 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00396194 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00383002 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0036544 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107337 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00381125 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0036544 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00357406 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0164942 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00497434 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00357406 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00365143 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105424 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00372888 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00365143 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00291026 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00998888 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00301 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00291026 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00280507 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00580828 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242611 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00242611 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00245966 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00683995 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247109 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00245966 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00365794 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00982491 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00367285 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00365794 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00265515 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00640735 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271655 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00265515 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267437 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593554 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00322804 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00267437 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00606743 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103605 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00365326 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00365326 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325777 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0096704 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334193 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00325777 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342618 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107131 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00357084 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00342618 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00554857 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105881 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00340648 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00340648 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0031679 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102122 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00327595 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0031679 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00329143 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00946714 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00338243 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00329143 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00404724 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0151621 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345894 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00345894 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00383242 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00995139 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00382665 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00382665 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326504 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106459 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00337286 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00326504 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00381161 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120819 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00332821 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00332821 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00335277 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107207 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346721 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00335277 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325735 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103742 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00338233 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00325735 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0040226 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01104 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0034843 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0034843 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033415 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103683 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00353873 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0033415 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00307025 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00984015 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00296592 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00296592 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00296676 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0165628 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00305225 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00296676 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00293523 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00660447 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00272276 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00272276 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0037324 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0097725 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00372911 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00372911 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0029329 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173298 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00332747 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0029329 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325704 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107334 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00336999 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00325704 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033014 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117662 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0042275 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0033014 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00322143 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112746 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00329922 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00322143 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00337669 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117996 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00367191 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00337669 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00301419 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01102 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00401613 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00301419 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00290404 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00985295 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00294391 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00290404 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00301571 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114082 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00313113 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00301571 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00303133 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114254 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00602546 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00303133 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00390783 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112668 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00393019 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00390783 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0026654 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.017376 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266083 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00266083 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270991 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0068 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269861 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00269861 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00268749 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00691222 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268216 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00268216 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269827 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0081633 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00272216 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00269827 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269664 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00679938 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270241 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00269664 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Add_1_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00317317 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00962413 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00318009 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00317317 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254861 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00624715 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255723 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00254861 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250835 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00660031 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025276 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00250835 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253049 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00661112 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025207 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0025207 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00419775 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00660447 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00421351 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00419775 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00255208 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613848 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255943 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00255208 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00258547 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587739 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00260123 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00258547 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254252 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590793 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253722 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00253722 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00255176 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587063 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253562 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00253562 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00255959 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00738651 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255151 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00255151 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,80,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00299057 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00578158 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00299276 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00299057 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00261868 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00702454 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00260056 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00260056 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00243611 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630976 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239886 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239886 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240198 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00638787 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241212 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00240198 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00424807 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00662192 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00422306 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00422306 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00260696 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595365 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00262757 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00260696 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00265795 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596267 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00265795 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00265795 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242983 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610324 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238949 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238949 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241105 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00992884 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024029 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0024029 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00255455 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101787 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00315617 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00255455 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(9600,3200,1,80,40) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00307103 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00998613 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00310718 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00307103 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00354843 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00956587 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002984 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.002984 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00298514 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103125 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00307443 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00298514 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00258735 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00640874 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246183 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246183 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00421015 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00661507 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00422279 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00421015 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00263713 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591324 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00264745 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00263713 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267742 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589915 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268639 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00267742 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024759 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606095 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254725 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0024759 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246376 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0075864 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248047 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00246376 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248244 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006056 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248883 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00248244 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1:4,20,10) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00306889 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00683794 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00322011 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00306889 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266997 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598057 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00265871 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00265871 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241318 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00668447 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248615 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00241318 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247748 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00662732 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247385 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00247385 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00391339 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00660447 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00391549 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00391339 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00322296 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594268 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00272328 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00272328 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00335086 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00989592 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00318578 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00318578 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00304408 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601524 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00273906 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00273906 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00314325 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100294 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00301467 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00301467 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0032382 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00924971 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00311692 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00311692 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(480,160,80:32,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00302467 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00990141 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00383254 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00302467 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00333225 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0071003 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00260231 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00260231 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00295258 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00677631 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00312646 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00295258 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00403721 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0168726 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00277767 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00277767 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00361314 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00689807 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.003628 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00361314 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00261594 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118924 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00295277 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00261594 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00278391 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00670732 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271129 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00271129 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269181 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00668322 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00273389 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00269181 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269249 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00667491 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00272112 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00269249 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270741 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00670649 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00273156 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00270741 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Float(3200,1:4,80,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00390956 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00675844 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00300295 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00300295 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254709 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619028 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025511 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00254709 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252415 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102704 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250396 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250396 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254974 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060021 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252993 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252993 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00387299 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599771 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00386644 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00386644 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252888 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00637595 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253057 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00252888 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00256123 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00667387 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025591 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0025591 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025609 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673247 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247385 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00247385 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246566 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00655875 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247425 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00246566 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247433 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0065361 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248315 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00247433 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(9600,3200,80,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00314216 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00771561 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00325756 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00314216 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270793 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00577499 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00259143 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00259143 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248946 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587301 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248977 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00248946 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252568 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011033 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253305 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00252568 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00383856 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594414 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0038657 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00383856 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254204 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608076 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00315011 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00254204 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239954 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606362 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238492 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238492 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246731 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606724 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247172 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00246731 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00258539 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598952 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024644 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0024644 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248851 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589824 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247543 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00247543 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(4800,1600,80:2,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00272052 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00773053 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00350249 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00272052 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0031356 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101001 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00325943 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0031356 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00313163 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.009506 [04/18/2023-18:31:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00326753 [04/18/2023-18:31:39] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00313163 [04/18/2023-18:31:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:39] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:39] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00319431 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0164642 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00322123 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00319431 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00382749 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584923 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00381245 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00381245 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00262234 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595257 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0040051 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00262234 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0026858 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589312 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267877 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00267877 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241189 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621009 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242859 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00241189 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00312368 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00640417 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239177 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239177 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246106 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006136 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242232 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00242232 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,1:8,10,5) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00301771 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621953 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00301819 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00301771 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266455 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058997 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267234 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266455 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242479 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00747611 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241699 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00241699 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00256065 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613162 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247023 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00247023 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0036344 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00583772 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0036368 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0036344 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00273475 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.005996 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00263431 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00263431 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00303819 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0099648 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00326151 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00303819 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00423368 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00819581 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247243 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00247243 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248662 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614743 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242301 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00242301 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00245075 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00734377 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245463 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00245075 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(720,240,1:16,6,3) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00302686 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598552 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00302886 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00302686 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266785 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590354 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349447 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266785 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00318253 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105832 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00342879 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00318253 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00336361 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106975 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00351164 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00336361 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00367309 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00999375 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0036528 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0036528 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00331055 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010101 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00341638 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00331055 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00324945 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010626 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00333023 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00324945 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00343271 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107269 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00556361 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00343271 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326431 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101556 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00339019 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00326431 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00340952 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100565 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347973 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00340952 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(480,160,80:32,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00341279 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106602 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00447257 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00341279 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00519739 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103791 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00329299 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00329299 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00331023 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105117 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345176 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00331023 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00336553 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120004 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0034277 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00336553 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00435602 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010896 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00363497 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00363497 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00324338 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.017311 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0034129 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00324338 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326109 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118407 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00403911 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00326109 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00402946 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102473 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349737 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00349737 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0032446 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119467 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00325455 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0032446 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00329268 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0112302 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00413799 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00329268 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,1:8,80,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00650016 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108633 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00336563 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00336563 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00377456 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102756 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00322326 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00322326 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00327678 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115161 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00330286 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00327678 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00451814 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119874 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00355735 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00355735 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00383675 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117029 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00385359 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00383675 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00330587 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0179606 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00425702 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00330587 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00351075 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120747 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00338264 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00338264 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00333427 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111627 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345001 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00333427 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00350093 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121371 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00411624 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00350093 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00421593 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00922857 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270603 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00270603 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(3200,3200:32,80,2,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Mul_3_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00304583 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00682689 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00307647 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00304583 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00592786 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00837359 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00593591 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00592786 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00642047 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0084061 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00643816 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00642047 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0535406 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00863301 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0537524 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00863301 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00638549 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00665538 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0039213 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0039213 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00684278 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0066693 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00682667 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0066693 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,3400,85,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.026112 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00699015 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0261379 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00699015 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00621317 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00849317 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0061739 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0061739 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0576853 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00779308 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0576366 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00779308 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00621124 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673787 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0062247 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00621124 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00665579 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00675304 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00665268 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00665268 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(408000,136000,1,3400,40) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0301961 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00654234 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0302519 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00654234 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00625411 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0085198 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00623384 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00623384 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0576884 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00780752 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0577219 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00780752 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00702476 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673953 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00702672 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00673953 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00754358 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00675761 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00747291 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00675761 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1:4,850,10) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0303077 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00651761 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0302519 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00651761 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00624139 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00850178 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00624715 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00624139 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00702912 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00852141 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00700517 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00700517 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0070104 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00896161 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00702999 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0070104 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00745623 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0124815 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00747703 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00745623 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(20400,6800,3400:32,85,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0298139 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104885 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.029845 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0104885 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00587447 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104676 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00588252 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00587447 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00642802 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00968655 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00645168 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00642802 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0536869 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00987185 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0535893 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00987185 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00611943 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130859 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00392834 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00392834 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00660218 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00624497 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00662836 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00624497 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(408000,136000,3400,85,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0260457 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00649517 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.026035 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00649517 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00629903 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00688348 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00631374 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00629903 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00705372 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00687804 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00705328 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00687804 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0537356 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0330021 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0535954 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0330021 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0111128 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0467566 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0109182 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0109182 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0112612 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0329499 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0117858 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0112612 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(204000,68000,3400:2,85,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0210573 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0256145 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0209894 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0209894 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00641491 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00670026 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00628591 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00628591 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00707026 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00672935 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00704283 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00672935 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0556846 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00660322 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0559787 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00660322 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00718834 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00677236 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00716731 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00677236 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1:4,850,10) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0283505 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0065893 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0283307 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0065893 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00629267 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00672603 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00629406 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00629267 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00702868 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00676218 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00704348 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00676218 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0560152 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00819708 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0559787 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00819708 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00672353 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00677735 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00671896 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00671896 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00718949 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00675553 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00717372 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00675553 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1:8,425,5) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.028323 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00658618 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0283429 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00658618 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00629664 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00678857 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00627597 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00627597 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00705633 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006704 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00708114 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.006704 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0560274 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00652197 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0562438 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00652197 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00673642 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00675553 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00668842 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00668842 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(30600,10200,1:16,255,3) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.028779 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00783037 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0287351 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00783037 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00629664 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00718469 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00628969 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00628969 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00704871 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00670296 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00705938 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00670296 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0553448 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00927457 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0553935 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00927457 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00673226 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00676758 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00671086 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00671086 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(20400,6800,3400:32,85,1) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_1_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00718034 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673829 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00718834 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00673829 [04/18/2023-18:31:40] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(408000,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3_copy_output (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326878 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618152 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00327055 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00326878 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(1,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3_copy_output (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033067 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0065706 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00328229 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00328229 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(1:4,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3_copy_output (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0143666 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.165888 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0143397 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0143397 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(408000:32,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3_copy_output (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0244023 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.166473 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.024413 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0244023 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(408000,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3_copy_output (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00329995 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613638 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00330867 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00329995 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(408000:2,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3_copy_output (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00613657 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0554773 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00615752 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00613657 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(1:4,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3_copy_output (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00614609 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0554971 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00617295 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00614609 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(1:8,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3_copy_output (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0144201 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0572495 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0143264 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0143264 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(1:16,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3_copy_output (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0244297 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.057827 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0243139 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0243139 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Half(408000:32,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3_copy_output (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0243185 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0575832 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0243962 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0243185 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(12800,400:4,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(12800,400:4,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) long-strided -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) long-strided -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) long-strided -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) long-strided -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) long-strided -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) long-strided -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.71/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00320325 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0224738 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00437122 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00320325 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.71/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00410501 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100891 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268038 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00268038 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.71/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0039906 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611067 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00400025 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0039906 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.71/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00313441 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104444 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00311861 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00311861 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.71/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00285454 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598076 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240686 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240686 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.71/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00412695 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602552 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249521 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249521 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.71/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00383663 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00710727 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00398032 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00383663 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.71/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00312745 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617981 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243936 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00243936 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.71/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00433538 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603429 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235069 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235069 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.70/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267606 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0224294 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00265482 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00265482 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.70/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0031684 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0073984 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026447 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0026447 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.70/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00427361 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00625809 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00430171 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00427361 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.70/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00313242 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102279 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00327522 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00313242 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.70/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00300971 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603962 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240076 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240076 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(12800,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.70/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00418011 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00624775 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248465 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248465 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.70/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038483 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609181 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00384217 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00384217 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.70/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00306218 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607886 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236148 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236148 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(1600,400:32,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: /model.70/conv/_input_quantizer/QuantizeLinear_output_0 copy (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00447471 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612171 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236837 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236837 [04/18/2023-18:31:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:40] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(102400,400,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(3200,400:32,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(204800,400,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(51200,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Int8(6400,400:32,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00429768 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00665371 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0042997 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00429768 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00484815 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610686 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00486111 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00484815 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00657974 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611581 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00660364 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00611581 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Float(1:4,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00572635 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00681426 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00571007 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00571007 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00229769 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0207099 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334246 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00229769 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00323352 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618267 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266506 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00266506 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00445728 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616171 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00289326 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00289326 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00444343 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108313 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00443359 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00443359 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00527233 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603638 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00529151 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00527233 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Half(1:8,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00850366 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00748846 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00476343 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00476343 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Half(102000:32,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.168814 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0226749 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.16896 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0226749 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Float(102000,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00421109 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00658286 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00410906 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00410906 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00376265 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00769468 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00373228 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00373228 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00771296 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612286 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00774039 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00612286 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Float(1:4,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0138348 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00885566 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0139445 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00885566 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Half(102000,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00402565 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614667 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00402286 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00402286 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00417254 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611733 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00417437 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00417254 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034708 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618324 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00341083 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00341083 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Half(6400,1:16,320,16) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034597 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062398 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00343423 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00343423 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00649413 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611619 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00648447 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00611619 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Half(1:8,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0146848 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00752625 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0146309 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00752625 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Half(102000:32,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.170277 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.02004 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.17525 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.02004 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Float(102000,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00405282 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00663792 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00407492 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00405282 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Float(102000,1,5100,255) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00331543 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00668675 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00325486 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00325486 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00767038 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0063521 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00768265 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0063521 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Float(1:4,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0138074 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00798959 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0137745 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00798959 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(102000,400,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0040513 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611638 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00407162 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0040513 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00413714 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608152 [04/18/2023-18:31:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00411677 [04/18/2023-18:31:40] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00411677 [04/18/2023-18:31:40] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:40] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00363692 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00672727 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00357314 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00357314 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(6400,1:16,320,16) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00359703 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629386 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00359474 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00359474 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00651158 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0061 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00653735 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0061 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(1:8,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0146144 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00751246 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0146107 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00751246 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(102000:32,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.171154 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0200611 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.171008 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0200611 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00407022 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00667595 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00405003 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00405003 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00322255 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00669236 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00321239 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00321239 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00389547 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613448 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.003904 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00389547 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Float(1:4,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0134699 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0079934 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0135206 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0079934 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00405409 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606476 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00405549 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00405409 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00409796 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600952 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00409535 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00409535 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00358857 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603562 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00361063 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00358857 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00360823 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600495 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0036032 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0036032 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00631473 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060779 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00633043 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0060779 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(1:8,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0143799 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00750446 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0142862 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00750446 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(102000:32,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.171154 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.020132 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.171154 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.020132 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00333374 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0438389 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334427 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00333374 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00451586 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0437851 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00450414 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00450414 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00499862 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0438126 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00502684 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00499862 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00681426 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0438 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00681339 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00681339 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00333044 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0232914 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00335064 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00333044 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00345099 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0212108 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346025 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00345099 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00464855 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0212323 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00460992 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00460992 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00461257 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0212532 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00460257 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00460257 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0054505 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.021169 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00545033 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00545033 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Half(1:8,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00852948 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0232104 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00854454 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00852948 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Half(102000:32,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.173349 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0215047 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.171447 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0215047 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00225164 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0207295 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00329486 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00225164 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00424309 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619028 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00422723 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00422723 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00466183 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629426 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00467097 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00466183 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00662649 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629664 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00666743 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00629664 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Float(1:4,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00572672 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0218867 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00571465 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00571465 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00315806 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00650036 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00265719 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00265719 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00430494 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00648705 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00284128 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00284128 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00431906 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00653486 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00428746 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00428746 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00524261 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00654047 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00520669 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00520669 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Half(1:8,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00840551 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00703608 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00481387 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00481387 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Half(102000:32,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.168229 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0163109 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.169691 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0163109 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00319766 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0063678 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00259865 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00259865 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0035258 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615962 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00355345 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0035258 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00417789 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062559 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00415229 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00415229 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00670483 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619486 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00670919 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00619486 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Float(1:4,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0127836 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.022033 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0128248 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0127836 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00314584 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00640835 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00259848 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00259848 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00375092 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00627796 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252279 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252279 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00390338 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00624338 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00372618 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00372618 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00527755 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626902 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00530252 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00527755 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Half(1:8,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.013536 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00858111 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0135485 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00858111 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Half(102000:32,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.168814 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0169788 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.168997 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0169788 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Float(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00419461 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610381 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254492 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00254492 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Float(102000,1,5100,255) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326888 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612629 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00326317 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00326317 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00390721 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00622887 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00387731 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00387731 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00761432 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608609 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00763886 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00608609 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Float(1:4,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0136029 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0221309 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0136744 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0136029 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Half(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00413779 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629267 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251068 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00251068 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00423086 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617257 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239954 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239954 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Half(6400,1:16,320,16) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00354799 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00644094 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00355401 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00354799 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00638072 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00623105 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00640397 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00623105 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Half(1:8,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0143488 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00818108 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0143031 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00818108 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Half(102000:32,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.170715 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0171967 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.170862 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0171967 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Float(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00419213 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609067 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00420679 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00419213 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Float(102000,1,5100,255) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0032667 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616952 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00324977 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00324977 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00388646 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00634137 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00390042 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00388646 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0076249 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616667 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00762129 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00616667 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Float(1:4,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0136274 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0221531 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0136345 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0136274 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Half(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00413283 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00632447 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00415569 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00413283 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00417789 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105394 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0041869 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00417789 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00356025 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105185 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00353561 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00353561 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00640238 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104617 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00638489 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00638489 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Half(1:8,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0143122 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103311 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0143237 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0103311 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Half(102000:32,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.170715 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0171505 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.171008 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0171505 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00412617 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614343 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00411624 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00411624 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326525 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619943 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00328343 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00326525 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00389708 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00627717 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00391586 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00389708 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00709769 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062241 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0071003 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0062241 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Float(1:4,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0130938 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0221159 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0131017 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0130938 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00402171 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00662109 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0040353 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00402171 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00408555 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00623006 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00408633 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00408555 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00356137 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630002 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0035685 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00356137 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00356204 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630301 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00354319 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00354319 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Half(1:8,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0138315 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00818997 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0138215 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00818997 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Half(102000:32,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.170277 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0173039 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.170423 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0173039 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033347 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0158888 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00328769 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00328769 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.004538 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0160102 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00453529 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00453529 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00504213 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0159741 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.005021 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.005021 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00679834 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0159644 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0068197 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00679834 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Float(1:4,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00586953 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0251604 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00588892 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00586953 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00331751 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0669013 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00328842 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00328842 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00333948 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0643718 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334512 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00333948 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00457429 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.064317 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00460157 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00457429 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.004584 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0642834 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00458371 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00458371 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00539936 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0643474 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00543018 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00539936 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Half(102000:32,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.173349 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0218109 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.171301 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0218109 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00717234 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0165262 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00716091 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00716091 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00773606 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0167721 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00766917 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00766917 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00787224 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0167959 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00776301 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00776301 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00886884 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0168584 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00890676 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00886884 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Float(1:4,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00946229 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0262629 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00949029 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00946229 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00648467 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.067584 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00648089 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00648089 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00656956 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0661699 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00650306 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00650306 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00706961 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0661699 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00698732 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00698732 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00697491 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0660724 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00704675 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00697491 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00703891 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0661044 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00702585 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00702585 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Half(1:8,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/m.2/Conv_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.012027 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102795 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.01196 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0102795 [04/18/2023-18:31:41] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Half(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00445617 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0066639 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00446771 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00445617 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,400,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Float(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Half(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Half(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00343238 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00690242 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345676 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00343238 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Half(6400,1:16,320,16) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,1,5100,255) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Float(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Float(102000,1,5100,255) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00360434 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00695097 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00360126 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00360126 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(6400,1:16,320,16) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(25600,1:4,1280,64) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00361132 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00890702 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00424847 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00361132 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(3200,400:32,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Half(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00461832 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0212376 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0046313 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00461832 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(1:4,400,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Half(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00430292 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119054 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00434687 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00430292 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000,400,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Half(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00480784 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111339 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00424793 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00424793 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(51200,400:2,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:4,1280,64) -> Float(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00420934 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106769 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00442791 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00420934 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:4,1280,64) -> Float(102000,1,5100,255) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00324997 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103788 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00326867 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00324997 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:4,1280,64) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00390857 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0063354 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00388127 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00388127 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:4,1280,64) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00759844 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618343 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0076237 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00618343 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:4,1280,64) -> Half(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00416418 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0064002 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00413322 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00413322 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:4,1280,64) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00422131 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621555 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00420396 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00420396 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:4,1280,64) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00354631 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109277 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00353405 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00353405 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:4,1280,64) -> Half(6400,1:16,320,16) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00370884 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0131096 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00357154 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00357154 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(25600,1:4,1280,64) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00637973 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00632248 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00638032 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00632248 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Float(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Float(102000,1,5100,255) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Half(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Half(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00357851 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00640417 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00357337 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00357337 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Half(6400,1:16,320,16) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(12800,1:8,640,32) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Float(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Float(102000,1,5100,255) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Half(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Half(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00365646 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110432 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00379657 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00365646 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(6400,1:16,320,16) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Half(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00364411 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109055 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00379609 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00364411 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(3200,400:32,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Half(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.004606 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0644038 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00465475 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.004606 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(1:8,400,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Float(102000,1,5100,255) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Half(25600,1:4,1280,64) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Transpose_2_output_0 -> ) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00695967 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0662187 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0160905 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00695967 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Half(6400,1:16,320,16) *************** [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,400,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:31:41] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0165563 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0250895 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00763019 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00763019 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00569248 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0167975 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00510237 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00510237 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0163291 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0183069 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0163068 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0163068 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00526612 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0152722 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00526041 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00526041 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00569284 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0154446 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.004496 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.004496 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00507901 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121554 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00399606 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00399606 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00438428 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104823 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00332177 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00332177 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0039694 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106638 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0036224 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0036224 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00861015 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105731 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00862144 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00861015 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00395367 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104088 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0039533 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0039533 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034265 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107582 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0035656 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0034265 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0165313 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102992 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.01715 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0102992 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00394279 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105747 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00591035 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00394279 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00400241 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105936 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00400787 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00400241 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00347864 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0151401 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00425829 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00347864 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00345121 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100047 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00423098 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00345121 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0035848 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107259 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00361006 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0035848 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00918771 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0169614 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00919771 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00918771 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00400508 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103086 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00401701 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00400508 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00322682 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103262 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0032383 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00322682 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0164165 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101912 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0164612 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0101912 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00403251 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103706 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00401143 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00401143 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00409286 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105006 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00410697 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00409286 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00348577 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626783 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00343543 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00343543 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00356304 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00620743 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00359417 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00356304 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00376349 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621158 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00374822 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00374822 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00918571 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616476 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00920086 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00616476 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00403911 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00722103 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00403619 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00403619 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00322265 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00694748 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00323109 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00322265 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344229 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00690025 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00344327 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00344229 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00404063 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605467 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00402374 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00402374 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00410423 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00650713 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00411324 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00410423 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342095 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612076 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00344827 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00342095 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00360057 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608648 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00359646 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00359646 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00374693 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605409 [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00372489 [04/18/2023-18:31:41] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00372489 [04/18/2023-18:31:41] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:41] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:41] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00942971 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616781 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00946114 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00616781 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00226493 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00632944 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00316184 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00226493 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00312616 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608914 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00312934 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00312616 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00330296 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062887 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00325797 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00325797 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0160544 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00624576 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.016157 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00624576 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00312248 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00628929 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266692 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00266692 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00318649 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0064479 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00295762 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00295762 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00328655 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00624596 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00300657 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00300657 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00350238 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00632169 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00350506 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00350238 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00853593 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630797 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0085526 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00630797 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00319644 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603429 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026107 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0026107 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0032854 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0068123 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00328364 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00328364 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00346025 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598552 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00350071 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00346025 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0163677 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00627955 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0163901 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00627955 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00310708 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00738651 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00260738 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00260738 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00337435 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602381 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00336393 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00336393 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00348103 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059392 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253698 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00253698 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00364274 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608286 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00361383 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00361383 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00701605 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606133 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00700996 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00606133 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00411664 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597467 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.004096 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.004096 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326867 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614457 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00324642 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00324642 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342824 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0061459 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00343782 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00342824 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0165415 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609543 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.016579 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00609543 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00406616 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00704327 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00405321 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00405321 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00408738 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060581 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00407314 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00407314 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00347135 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619905 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346286 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00346286 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00363851 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630579 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00363897 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00363851 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00909686 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619676 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00911543 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00619676 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00409051 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120701 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254669 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00254669 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326597 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599105 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00327969 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00326597 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034609 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604248 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00417176 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0034609 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0165496 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595695 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0165156 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00595695 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00400368 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00731977 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242991 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00242991 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00406641 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.013322 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236156 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236156 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00335968 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00625809 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00335809 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00335809 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.003608 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00622668 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00596571 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.003608 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00916829 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00755777 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00917657 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00755777 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00399555 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059821 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00400508 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00399555 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325517 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0127379 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00325777 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00325517 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344533 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607372 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00344272 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00344272 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0164394 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595505 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0164988 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00595505 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00515004 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.007368 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00397308 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00397308 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00397917 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606267 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00399086 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00397917 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00336521 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0179141 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334437 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00334437 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034819 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0061619 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00348027 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00348027 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00918514 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608057 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00918886 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00608057 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00515673 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594578 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0040127 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0040127 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00327034 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593719 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00326442 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00326442 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342716 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00913371 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347157 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00342716 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0165303 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060381 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0165491 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0060381 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00397155 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00722994 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00396207 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00396207 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00329288 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600972 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00330306 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00329288 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00333821 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613924 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00335798 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00333821 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00415843 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00733714 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345176 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00345176 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Sigmoid_2_output_0) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00362057 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612819 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00362354 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00362057 [04/18/2023-18:31:42] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00229558 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00753662 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00560721 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00229558 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00317806 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610248 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266921 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00266921 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00335575 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615524 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00285006 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00285006 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00623789 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00723863 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00397028 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00397028 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00393242 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588215 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00393711 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00393242 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00398692 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00868764 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00398971 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00398692 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00334405 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599771 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346395 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00334405 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00399467 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00722606 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00400673 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00399467 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00401194 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598457 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00402832 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00401194 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00407251 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00622132 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00405486 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00405486 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00360469 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00622533 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0036008 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0036008 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00402222 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00723406 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00407276 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00402222 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00403263 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00707918 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00405105 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00403263 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00412486 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604705 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00412173 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00412173 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00358789 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059456 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00359017 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00358789 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00378298 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00628392 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00317531 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00317531 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00311861 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00631314 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00272164 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00272164 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00329195 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103017 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00295855 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00295855 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00319756 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058891 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00260746 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00260746 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00311602 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0070892 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00353394 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00311602 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00346416 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602057 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245904 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00245904 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0041152 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600229 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00411259 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00411259 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00522384 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00707788 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00407098 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00407098 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00408947 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605657 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00407035 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00407035 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00347625 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00909086 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00449614 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00347625 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00409156 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596114 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253089 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00253089 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00401219 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00730697 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239452 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239452 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00522694 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598438 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237677 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237677 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00400279 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600762 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00397879 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00397879 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00397447 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00738331 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00395923 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00395923 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00399759 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604114 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00400482 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00399759 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00346819 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00650286 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349018 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00346819 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00399416 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00399848 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00399416 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00395676 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.007256 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00396978 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00395676 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00330608 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602895 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00331356 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00330608 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Sigmoid_2_output_0 -> ) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00346765 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604057 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347679 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00346765 [04/18/2023-18:31:42] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) long-strided -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00304019 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00682928 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0030543 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00304019 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) long-strided -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00315925 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00679668 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00316591 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00315925 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) long-strided -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0155781 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00677278 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0155593 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00677278 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) long-strided -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00303552 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00635309 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00304 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00303552 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) long-strided -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00313113 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602819 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00312566 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00312566 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) long-strided -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00404876 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600533 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0031512 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0031512 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) long-strided -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00324114 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594377 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00324114 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00324114 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) long-strided -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00431965 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599029 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347331 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00347331 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) long-strided -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00832914 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599791 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00830451 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00599791 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) long-strided -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00303676 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00625073 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00303143 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00303143 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) long-strided -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00304895 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591744 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0030399 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0030399 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) long-strided -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00315786 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00647394 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0032908 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00315786 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) long-strided -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0154359 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611352 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0153449 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00611352 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) long-strided -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00304039 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613962 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00303448 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00303448 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) long-strided -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00312507 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629685 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00313431 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00312507 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) long-strided -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00323952 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613448 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00322458 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00322458 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) long-strided -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342879 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0072464 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00344044 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00342879 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) long-strided -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.008368 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00664062 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00831441 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00664062 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) long-strided -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00313997 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596572 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00312447 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00312447 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) long-strided -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00316343 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00636144 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00317785 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00316343 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) long-strided -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00335596 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598533 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00335277 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00335277 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) long-strided -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0157851 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598457 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0158542 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00598457 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) long-strided -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00304652 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00748937 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00302238 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00302238 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) long-strided -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00328166 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00729166 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00328447 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00328166 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) long-strided -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00334235 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594743 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00333608 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00333608 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) long-strided -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0035784 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0059981 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00358263 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0035784 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) long-strided -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00710095 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600781 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00710313 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00600781 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) long-strided -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00412486 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587447 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00413479 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00412486 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) long-strided -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00314753 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00726308 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00317287 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00314753 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) long-strided -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00335383 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617676 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00336021 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00335383 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) long-strided -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0157367 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060541 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0163357 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0060541 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) long-strided -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00410984 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00745577 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00410553 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00410553 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) long-strided -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00411311 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595962 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00410945 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00410945 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) long-strided -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00328218 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00627498 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00326836 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00326836 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) long-strided -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00358034 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629188 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00358411 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00358034 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) long-strided -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00881506 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00726217 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00880457 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00726217 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(97200,32400,1620,81,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00302809 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00648964 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00300952 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00300952 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(97200,32400,1620,81,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00305138 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00682754 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00303924 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00303924 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(97200,32400,1620,81,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00316979 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00682253 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00317836 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00316979 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(97200,32400,1620,81,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0155291 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00685061 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0156731 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00685061 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(97200,32400,1620,81,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00301857 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00635528 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00302933 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00301857 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(97200,32400,1620,81,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00312666 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629227 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00323586 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00312666 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(97200,32400,1620,81,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00314315 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00905 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00314087 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00314087 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(97200,32400,1620,81,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00322154 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591854 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00322469 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00322154 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(97200,32400,1620,81,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00346961 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00712805 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00449257 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00346961 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Float(97200,32400,1620,81,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00833854 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603143 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00833422 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00603143 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(97200,32400,1620,81,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00303543 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00625351 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00299457 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00299457 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(97200,32400,1620,81,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00307161 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595581 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00306004 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00306004 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(97200,32400,1620,81,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00317542 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606571 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0031686 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0031686 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(97200,32400,1620,81,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0155054 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00729806 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0155035 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00729806 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(97200,32400,1620,81,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00296798 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00632964 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00296238 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00296238 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(97200,32400,1620,81,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00300619 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00708821 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00304914 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00300619 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(97200,32400,1620,81,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00313689 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00622092 [04/18/2023-18:31:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0031366 [04/18/2023-18:31:42] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0031366 [04/18/2023-18:31:42] [V] [TRT] *************** Autotuning Reformat: Half(97200,32400,1620,81,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:42] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00321361 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610457 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00377203 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00321361 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(97200,32400,1620,81,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00340263 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617543 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00342531 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00340263 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(97200,32400,1620,81,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0082941 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618857 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00830476 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00618857 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1620:2,81,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00313292 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00769877 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00314594 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00313292 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1620:2,81,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00316293 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588069 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00316949 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00316293 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1620:2,81,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00335936 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00683276 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00336808 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00335936 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1620:2,81,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0158729 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600876 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0158126 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00600876 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1620:2,81,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00302181 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00734286 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00301838 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00301838 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1620:2,81,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266066 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594066 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026621 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266066 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1620:2,81,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0032881 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607581 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00327719 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00327719 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1620:2,81,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033415 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596914 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334777 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0033415 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1620:2,81,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00358023 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599029 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00358994 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00358023 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(48600,16200,1620:2,81,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00708724 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00877903 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00709725 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00708724 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(14580,4860,1:8,243,3) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00403632 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591598 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00423704 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00403632 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(14580,4860,1:8,243,3) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00316551 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609905 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00317009 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00316551 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(14580,4860,1:8,243,3) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00334756 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617086 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00340974 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00334756 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(14580,4860,1:8,243,3) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.015696 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006028 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0157129 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.006028 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(14580,4860,1:8,243,3) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00396306 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00748343 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00396615 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00396306 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(14580,4860,1:8,243,3) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00399746 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596857 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00400355 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00399746 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(14580,4860,1:8,243,3) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326545 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00707222 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00330712 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00326545 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(14580,4860,1:8,243,3) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00337712 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00620171 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00339189 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00337712 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(14580,4860,1:8,243,3) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00358183 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00624139 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00358503 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00358183 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(14580,4860,1:8,243,3) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> /model.77/Split_2_output_2) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00883792 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603391 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00884787 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00603391 [04/18/2023-18:31:43] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00232383 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060819 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023304 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00232383 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235796 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121928 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023402 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0023402 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269947 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605181 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270818 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00269947 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233003 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589349 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234822 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00233003 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00192396 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00624676 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237834 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00192396 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237422 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602019 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00200235 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00200235 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234679 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00624219 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240686 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234679 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235691 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00596933 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236598 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235691 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239962 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603181 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242588 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239962 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.002384 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00576914 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00222861 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00222861 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00339083 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597505 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00342879 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00339083 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00232649 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609314 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232678 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00232649 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(600,200,1:4,10,5) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00231845 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00967863 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00366816 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00231845 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(120,40,40:32,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342977 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106322 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00357931 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00342977 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00367473 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119459 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00385636 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00367473 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00323058 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010155 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00321707 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00321707 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00301695 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00870588 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235444 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235444 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(360,120,1:8,6,3) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00232413 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616971 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234852 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00232413 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(240,80,1:16,4,2) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234559 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00654836 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234138 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234138 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(120,40,40:32,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246826 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607562 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283769 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00246826 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249663 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00698275 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247693 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00247693 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00343565 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00685235 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00343826 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00343565 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235923 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612286 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236605 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235923 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(2400,800,1,40,20) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00230739 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00623781 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232855 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00230739 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(120,40,40:32,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269257 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621754 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269896 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00269257 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250835 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.007008 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249427 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249427 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236485 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613429 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235069 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235069 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023641 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617924 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237812 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0023641 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(360,120,1:8,6,3) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235489 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611905 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023635 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235489 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(240,80,1:16,4,2) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023623 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605638 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237445 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0023623 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(120,40,40:32,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00259078 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611695 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251188 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00251188 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253153 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00675408 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250972 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250972 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00345121 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00679086 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346416 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00345121 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239802 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609257 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023981 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239802 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00230901 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617505 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232973 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00230901 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233799 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616724 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234934 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00233799 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.002545 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00686629 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252872 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252872 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239451 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608514 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240594 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239451 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240823 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603657 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241722 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00240823 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246889 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606724 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233961 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00233961 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236508 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601524 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237497 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236508 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251749 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606724 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248181 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248181 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025511 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00668883 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254476 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00254476 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00389276 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00674992 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00395218 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00389276 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234799 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595581 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234882 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234799 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00245718 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00668634 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250105 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00245718 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249064 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00670068 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248575 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248575 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00272405 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00669174 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00276484 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00272405 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235991 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591634 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240472 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235991 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242975 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00681731 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244448 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00242975 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00260754 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00657454 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252808 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252808 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251212 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00656873 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250522 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250522 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253891 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00667761 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251846 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00251846 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236942 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591781 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237512 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236942 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00345328 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00579602 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345567 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00345328 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00192104 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605181 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00213042 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00192104 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00231263 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591836 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232324 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00231263 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234672 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598324 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233261 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00233261 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270042 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592311 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270844 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00270042 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235916 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00580078 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234739 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234739 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00226236 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613943 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00200089 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00200089 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00232339 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609505 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235436 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00232339 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00231521 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606933 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023217 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00231521 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241768 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00669049 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242634 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00241768 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235136 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592366 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00226771 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00226771 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00339285 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00624676 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00340648 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00339285 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233276 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584887 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00194557 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00194557 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00232818 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058293 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233534 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00232818 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023635 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058165 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235916 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235916 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00269973 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584393 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271707 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00269973 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00243719 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0066826 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024272 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0024272 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00227019 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618895 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00193106 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00193106 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234469 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597067 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00224057 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00224057 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00232324 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599162 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233541 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00232324 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246121 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599752 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244393 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00244393 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00244479 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107396 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024251 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0024251 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00343935 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00677153 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00344337 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00343935 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235668 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589111 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00214646 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00214646 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(2400,800,1,40,20) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233032 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599581 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233143 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00233032 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(600,200,1:4,10,5) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238453 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605429 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241006 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238453 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(120,40,40:32,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00279868 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104379 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00303524 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00279868 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00258596 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00665683 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251236 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00251236 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00231093 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00768842 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00216433 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00216433 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00232265 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591927 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0020951 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0020951 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(240,80,1:16,4,2) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233106 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604286 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232347 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00232347 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(120,40,40:32,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00243642 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599619 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243223 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00243223 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249537 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00671688 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249868 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00249537 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00345012 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00677506 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346133 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00345012 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235916 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00665455 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00422252 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235916 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(2400,800,1,40,20) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00342291 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0072192 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233969 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00233969 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(600,200,1:4,10,5) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00292736 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105851 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00443913 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00292736 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(120,40,40:32,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00392463 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.011399 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00406413 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00392463 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00404432 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0155685 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00449271 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00404432 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00396998 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116118 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00415386 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00396998 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00384325 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110878 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00437001 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00384325 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(360,120,1:8,6,3) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00402247 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0126293 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00426165 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00402247 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(120,40,40:32,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00402565 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111331 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00426891 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00402565 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00403111 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0135335 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00440686 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00403111 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00387188 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0149655 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00465548 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00387188 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00382111 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107739 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00410371 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00382111 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00381498 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115685 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0041647 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00381498 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00388856 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120225 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00439868 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00388856 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00394626 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01166 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00407327 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00394626 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00394712 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0155209 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00435519 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00394712 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00389869 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111578 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00412878 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00389869 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00382821 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107559 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00402654 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00382821 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00400571 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107624 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00415229 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00400571 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00404686 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108878 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00429862 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00404686 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00394996 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121455 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0041229 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00394996 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00396849 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0122869 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00415046 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00396849 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00380463 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105953 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334756 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00334756 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00394279 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121383 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00408633 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00394279 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00391771 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012069 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00409887 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00391771 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00398755 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120469 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00402527 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00398755 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00392204 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010752 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00414785 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00392204 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00391005 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109793 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00351052 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00351052 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00386619 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012285 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00395218 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00386619 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00402832 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0122453 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00416405 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00402832 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00403289 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0123082 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0042884 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00403289 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00393316 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0123303 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00407213 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00393316 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00387768 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106462 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0040113 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00387768 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00482362 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106818 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.004016 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.004016 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0039486 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0121661 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00409169 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0039486 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00402743 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118787 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0040066 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0040066 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00429889 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117816 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0041583 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0041583 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00393563 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105535 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00414694 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00393563 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00394934 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0109228 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00404279 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00394934 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038888 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012005 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00400038 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0038888 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00395564 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0124316 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00409508 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00395564 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00399657 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0123448 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00409861 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00399657 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00395058 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0120564 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00409874 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00395058 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Split_2_output_0 -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00388423 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104428 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00411233 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00388423 [04/18/2023-18:31:43] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,40,2,1) -> Float(800,800,1,40,20) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038893 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106335 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.004024 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0038893 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,40,2,1) -> Float(200,200,1:4,10,5) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00405511 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107507 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00420518 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00405511 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,40,2,1) -> Float(40,40,40:32,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00383868 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110527 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00434119 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00383868 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,40,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038888 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107174 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00407492 [04/18/2023-18:31:43] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0038888 [04/18/2023-18:31:43] [V] [TRT] *************** Autotuning Reformat: Float(800,800,40,2,1) -> Half(800,800,40,2,1) *************** [04/18/2023-18:31:43] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00335011 [04/18/2023-18:31:43] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010706 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349993 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00335011 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,800,40,2,1) -> Half(400,400,40:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.003776 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105881 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0033886 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0033886 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,800,40,2,1) -> Half(120,120,1:8,6,3) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00386323 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106942 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00327096 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00327096 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,800,40,2,1) -> Half(80,80,1:16,4,2) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00396281 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105809 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00412565 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00396281 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,800,40,2,1) -> Half(40,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00383747 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106616 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00400051 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00383747 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,800,40,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00378057 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0103654 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00324748 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00324748 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,800,40,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0038252 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106266 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00388794 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0038252 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1,40,20) -> Float(800,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00382268 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110101 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00392896 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00382268 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1,40,20) -> Float(200,200,1:4,10,5) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00390684 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108402 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00406349 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00390684 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1,40,20) -> Float(40,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00384229 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0107504 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00394526 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00384229 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1,40,20) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00409639 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.012157 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00426998 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00409639 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1,40,20) -> Half(800,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00390536 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117078 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00415974 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00390536 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1,40,20) -> Half(400,400,40:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00379537 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113741 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00399187 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00379537 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1,40,20) -> Half(120,120,1:8,6,3) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00392228 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110256 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00406336 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00392228 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1,40,20) -> Half(80,80,1:16,4,2) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00403721 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.010686 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00413623 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00403721 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1,40,20) -> Half(40,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00391228 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0105345 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00409012 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00391228 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1,40,20) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00394304 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0122126 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00412082 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00394304 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,800,1,40,20) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00402133 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0124392 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0038298 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0038298 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(200,200,1:4,10,5) -> Float(800,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00380716 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0106717 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346362 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00346362 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(200,200,1:4,10,5) -> Float(800,800,1,40,20) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00309145 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0104441 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00320244 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00309145 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(200,200,1:4,10,5) -> Float(40,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00292842 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617505 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026632 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0026632 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(200,200,1:4,10,5) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246384 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00692267 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245462 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00245462 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(200,200,1:4,10,5) -> Half(800,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234889 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617828 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236965 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234889 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(200,200,1:4,10,5) -> Half(400,400,40:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240053 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606971 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023936 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0023936 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(200,200,1:4,10,5) -> Half(120,120,1:8,6,3) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236246 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608038 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235459 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235459 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(200,200,1:4,10,5) -> Half(80,80,1:16,4,2) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234372 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617353 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237325 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234372 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(200,200,1:4,10,5) -> Half(40,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00245827 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595164 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246542 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00245827 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(200,200,1:4,10,5) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247504 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00665621 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00263331 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00247504 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(200,200,1:4,10,5) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00362766 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00684278 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00361497 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00361497 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(40,40,40:32,2,1) -> Float(800,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240556 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603867 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247314 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00240556 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(40,40,40:32,2,1) -> Float(800,800,1,40,20) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00305634 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0101135 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023695 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0023695 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(40,40,40:32,2,1) -> Float(200,200,1:4,10,5) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235354 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616286 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236328 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235354 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(40,40,40:32,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250691 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00711097 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025038 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0025038 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(40,40,40:32,2,1) -> Half(800,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247267 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621505 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241783 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00241783 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(40,40,40:32,2,1) -> Half(400,400,40:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242673 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610476 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241425 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00241425 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(40,40,40:32,2,1) -> Half(120,120,1:8,6,3) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237902 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606343 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237115 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237115 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(40,40,40:32,2,1) -> Half(80,80,1:16,4,2) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235294 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605086 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023647 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235294 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(40,40,40:32,2,1) -> Half(40,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250223 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601124 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248363 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248363 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(40,40,40:32,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253939 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00675262 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253033 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00253033 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(40,40,40:32,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00363371 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00677797 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0036208 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0036208 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(800,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023719 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601314 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236883 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236883 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(800,800,1,40,20) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00279385 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00681774 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024722 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0024722 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(200,200,1:4,10,5) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251381 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00680446 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251661 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00251381 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(40,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270749 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00730446 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00272181 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00270749 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(800,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237287 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615562 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235406 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235406 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(400,400,40:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00244819 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00681556 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00259894 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00244819 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(120,120,1:8,6,3) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250907 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00678151 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00307881 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00250907 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(80,80,1:16,4,2) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00323088 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00964389 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026494 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0026494 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(40,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00262757 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00683146 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025191 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0025191 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238522 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604914 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237782 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237782 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00375138 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605143 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0035952 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0035952 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800,40,2,1) -> Float(800,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0019147 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00633421 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00207887 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0019147 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800,40,2,1) -> Float(800,800,1,40,20) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235166 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611771 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235181 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235166 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800,40,2,1) -> Float(200,200,1:4,10,5) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240549 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617676 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235901 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235901 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800,40,2,1) -> Float(40,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266819 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619352 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00266633 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00266633 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800,40,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234387 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613429 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232855 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00232855 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800,40,2,1) -> Half(400,400,40:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00231536 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00637853 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00202006 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00202006 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800,40,2,1) -> Half(120,120,1:8,6,3) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00231506 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630976 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00230983 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00230983 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800,40,2,1) -> Half(80,80,1:16,4,2) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00231506 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00628909 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00231587 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00231506 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800,40,2,1) -> Half(40,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238751 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00634932 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025264 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238751 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800,40,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237295 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00756823 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245486 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237295 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800,40,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00359314 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00643299 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00361086 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00359314 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(400,400,40:2,2,1) -> Float(800,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00285347 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115766 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00284002 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00284002 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(400,400,40:2,2,1) -> Float(800,800,1,40,20) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00309593 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115161 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00312248 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00309593 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(400,400,40:2,2,1) -> Float(200,200,1:4,10,5) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00260571 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607657 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240472 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240472 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(400,400,40:2,2,1) -> Float(40,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00270456 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599067 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026836 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0026836 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(400,400,40:2,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241775 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00945486 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0032191 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00241775 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(400,400,40:2,2,1) -> Half(800,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00275894 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0063195 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00196196 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00196196 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(400,400,40:2,2,1) -> Half(120,120,1:8,6,3) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266557 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00637476 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00221236 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00221236 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(400,400,40:2,2,1) -> Half(80,80,1:16,4,2) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234215 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614628 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234679 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234215 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(400,400,40:2,2,1) -> Half(40,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025001 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00634037 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250747 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0025001 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(400,400,40:2,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024093 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00686237 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238941 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238941 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(400,400,40:2,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00363417 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0068935 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00365166 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00363417 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(120,120,1:8,6,3) -> Float(800,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236058 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605257 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00209703 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00209703 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(120,120,1:8,6,3) -> Float(800,800,1,40,20) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234949 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611486 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236103 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234949 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(120,120,1:8,6,3) -> Float(200,200,1:4,10,5) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236972 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00637098 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237002 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236972 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(120,120,1:8,6,3) -> Float(40,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267852 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601162 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269706 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00267852 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(120,120,1:8,6,3) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246338 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00678795 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024815 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00246338 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(120,120,1:8,6,3) -> Half(800,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233128 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062404 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00208305 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00208305 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(120,120,1:8,6,3) -> Half(400,400,40:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235264 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0063042 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00210548 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00210548 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(120,120,1:8,6,3) -> Half(80,80,1:16,4,2) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023155 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00637913 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234762 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0023155 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(120,120,1:8,6,3) -> Half(40,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242133 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617257 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243464 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00242133 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(120,120,1:8,6,3) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242782 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00693246 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240861 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240861 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(120,120,1:8,6,3) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00371821 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00692354 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00366523 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00366523 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(80,80,1:16,4,2) -> Float(800,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023853 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611314 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023728 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0023728 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(80,80,1:16,4,2) -> Float(800,800,1,40,20) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233593 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611733 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023416 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00233593 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(80,80,1:16,4,2) -> Float(200,200,1:4,10,5) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237122 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616057 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237085 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237085 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(80,80,1:16,4,2) -> Float(40,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00266802 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601505 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0027012 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00266802 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(80,80,1:16,4,2) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248134 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00680882 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248047 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248047 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(80,80,1:16,4,2) -> Half(800,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235046 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00622668 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235526 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235046 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(80,80,1:16,4,2) -> Half(400,400,40:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.002368 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616209 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236305 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236305 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(80,80,1:16,4,2) -> Half(120,120,1:8,6,3) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023315 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618324 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233659 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0023315 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(80,80,1:16,4,2) -> Half(40,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242813 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615086 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242937 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00242813 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(80,80,1:16,4,2) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00244595 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0068861 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244804 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00244595 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(80,80,1:16,4,2) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00362549 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00695554 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00361349 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00361349 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(40,40,40:32,2,1) -> Float(800,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239741 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006036 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239314 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239314 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(40,40,40:32,2,1) -> Float(800,800,1,40,20) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235459 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610667 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234619 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234619 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(40,40,40:32,2,1) -> Float(200,200,1:4,10,5) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235886 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609848 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237752 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235886 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(40,40,40:32,2,1) -> Float(40,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00267319 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606267 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00274866 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00267319 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(40,40,40:32,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247149 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00688784 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246471 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246471 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(40,40,40:32,2,1) -> Half(800,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235504 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00644671 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236096 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235504 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(40,40,40:32,2,1) -> Half(400,400,40:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00232789 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612571 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232804 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00232789 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(40,40,40:32,2,1) -> Half(120,120,1:8,6,3) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234035 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616057 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234275 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234035 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(40,40,40:32,2,1) -> Half(80,80,1:16,4,2) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00231993 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615276 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233283 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00231993 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(40,40,40:32,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246589 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00691657 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244362 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00244362 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(40,40,40:32,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00365097 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00699189 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00365817 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00365097 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(800,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235923 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599486 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0020348 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0020348 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(800,800,1,40,20) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248378 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00675969 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247275 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00247275 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(200,200,1:4,10,5) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252792 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00687238 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251172 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00251172 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(40,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00271966 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00676862 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00273121 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00271966 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238149 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616571 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241082 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238149 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(800,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241128 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00647592 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00205192 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00205192 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(400,400,40:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00245501 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00694814 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239977 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239977 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(120,120,1:8,6,3) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248497 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00695206 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246408 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246408 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(80,80,1:16,4,2) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247212 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00693268 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247882 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00247212 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(40,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00259755 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00719337 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250451 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250451 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00359383 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619028 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00367004 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00359383 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(800,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00243866 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608914 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0024485 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00243866 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(800,800,1,40,20) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00409038 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114715 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00263863 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00263863 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(200,200,1:4,10,5) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254524 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0068049 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00256882 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00254524 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(40,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00272871 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00704827 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00277635 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00272871 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024461 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613333 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242495 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00242495 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(800,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242619 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00649163 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238918 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238918 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(400,400,40:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00261303 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00695097 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00256384 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00256384 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(120,120,1:8,6,3) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249482 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00697121 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250546 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00249482 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(80,80,1:16,4,2) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248418 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00693507 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248867 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00248418 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(40,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252439 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00699951 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252271 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252271 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 690) [Constant]_output -> ) (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241326 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615847 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238636 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238636 [04/18/2023-18:31:44] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(600,200,1:4,10,5) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(120,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(360,120,1:8,6,3) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(240,80,1:16,4,2) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(120,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(2400,800,1,40,20) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(120,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(360,120,1:8,6,3) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(240,80,1:16,4,2) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(120,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(2400,800,1,40,20) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(600,200,1:4,10,5) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(120,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(240,80,1:16,4,2) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(120,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(2400,800,1,40,20) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(600,200,1:4,10,5) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(120,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(360,120,1:8,6,3) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(120,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,1:4,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(6,2,2:32,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2,1:4,2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:8,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,1:16,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(6,2,2:32,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2,1:8,2,2,1) -> Half(2,2:32,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(6,2,1,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(6,2,1:4,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(6,2,2:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Float(2,1:4,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,2:2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,1:8,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,1:16,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(6,2,2:32,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Half(2,2:32,2,2,1) -> Half(2,1:8,2,2,1) *************** [04/18/2023-18:31:44] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235773 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00638629 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235436 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235436 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00232944 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604895 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232147 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00232147 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236148 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606305 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235496 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235496 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00283805 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606629 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00282998 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00282998 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235361 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00633679 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238271 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235361 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238007 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600895 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002374 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.002374 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236103 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060141 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023701 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236103 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237085 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599371 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237047 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237047 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235556 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598076 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237669 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235556 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251717 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608895 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249301 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249301 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237325 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606819 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236635 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236635 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00231845 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00644074 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00230688 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00230688 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00231808 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00635826 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232642 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00231808 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0028255 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616838 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002835 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0028255 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237917 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00652405 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237894 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237894 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240191 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602305 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239619 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239619 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023214 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00631195 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233784 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0023214 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00231447 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626624 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233379 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00231447 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234799 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00623284 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235144 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234799 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251589 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605695 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249663 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249663 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239909 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603067 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238067 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238067 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241006 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626882 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235301 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235301 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235121 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00638648 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236755 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235121 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00281941 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615714 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00284056 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00281941 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239688 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613219 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240571 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239688 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253418 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0124099 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00279455 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00253418 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234612 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630698 [04/18/2023-18:31:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236538 [04/18/2023-18:31:44] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234612 [04/18/2023-18:31:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:44] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:44] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236508 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00624199 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236628 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236508 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235406 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626166 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239688 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235406 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253177 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606895 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252263 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252263 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241943 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603276 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241372 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00241372 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00232634 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606514 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023231 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0023231 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235594 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619047 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234679 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234679 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00278013 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608838 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00278198 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00278013 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240876 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613486 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244316 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00240876 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247157 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597257 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245687 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00245687 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235076 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608533 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236785 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235076 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023668 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593554 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235908 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235908 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.002365 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599486 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235534 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235534 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252022 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595905 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253217 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00252022 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238865 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613962 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236665 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236665 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00272785 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00678005 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249955 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249955 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251894 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0068197 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248709 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248709 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00281116 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00678587 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00280309 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00280309 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240373 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614933 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238964 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238964 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248757 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00677423 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250199 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00248757 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251733 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00676592 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249781 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249781 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253089 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673579 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250349 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250349 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0025134 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00681818 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251365 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0025134 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00259796 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00678732 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00263971 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00259796 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023689 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00633401 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235526 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235526 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00231757 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00594048 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232509 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00231757 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234072 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609219 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236216 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234072 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00277662 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612019 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00275481 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00275481 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234417 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673434 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236403 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234417 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236246 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621476 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023656 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236246 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00230732 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0063036 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00231241 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00230732 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00230614 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00620762 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002336 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00230614 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00232339 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619638 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234057 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00232339 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00243758 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00622151 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244138 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00243758 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238705 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601238 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238895 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00238705 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233843 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600457 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234252 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00233843 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023743 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060741 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248047 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0023743 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00279599 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598076 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00280264 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00279599 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235646 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00671169 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237737 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235646 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236852 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606095 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236867 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236852 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235961 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600667 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235451 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235451 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023304 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610114 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233453 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0023304 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234897 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597429 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023827 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234897 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00259225 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630281 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00256114 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00256114 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240274 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600838 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239147 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239147 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.002365 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600781 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002392 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.002365 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236126 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605791 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239901 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236126 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00277802 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600552 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00277002 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00277002 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024327 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605181 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237242 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237242 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00243347 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599391 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240815 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240815 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00232324 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00628929 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00231314 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00231314 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233099 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00627086 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232708 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00232708 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237482 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611619 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002371 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.002371 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249119 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601181 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248757 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248757 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250262 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606571 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241722 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00241722 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.002342 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617028 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023259 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0023259 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.002384 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616457 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235758 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235758 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00276422 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602229 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00278224 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00276422 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237182 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00623543 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240221 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237182 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246237 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595543 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242619 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00242619 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00232214 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00628432 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232582 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00232214 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233932 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00609162 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240297 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00233932 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00261727 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00626027 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237894 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237894 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248512 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006104 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248717 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00248512 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240831 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00681558 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002392 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.002392 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00232288 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600876 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232981 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00232288 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235946 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606248 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234956 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234956 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00276985 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604648 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00275982 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00275982 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238216 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616628 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238074 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238074 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240686 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608514 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242999 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00240686 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00231889 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00615219 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00231263 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00231263 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023885 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595638 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232546 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00232546 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235414 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599829 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025268 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235414 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00260405 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610152 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251316 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00251316 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024016 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0058165 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241417 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0024016 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250294 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00652426 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254035 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00250294 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254564 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00657517 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253771 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00253771 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00280668 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00662982 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00279112 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00279112 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241882 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0067468 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237265 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237265 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249324 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0066801 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248095 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248095 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00246299 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00689306 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246849 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00246299 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249096 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00669486 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247385 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00247385 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249545 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00686999 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00256571 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00249545 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254958 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00682536 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254613 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00254613 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242534 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593006 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241524 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00241524 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00255608 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00654899 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00256523 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00255608 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00255747 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00668862 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00262849 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00255747 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00282828 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00668405 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00282272 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00282272 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239878 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00673455 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239611 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239611 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251509 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00688566 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00250333 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00250333 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249608 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00692463 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249017 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249017 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249482 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00688261 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248166 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248166 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252551 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00688479 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249852 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249852 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Add_2_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00256416 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00693856 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00257723 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00256416 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235061 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00641093 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236365 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235061 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234402 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00602286 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232487 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00232487 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236395 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060221 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235129 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235129 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00281519 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604571 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00281439 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00281439 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023722 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00766099 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00309398 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0023722 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00283904 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589477 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241577 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00241577 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234072 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618305 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234814 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234072 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00243556 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603524 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244052 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00243556 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236853 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00593682 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235519 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235519 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,40,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247945 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.007208 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248079 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00247945 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240907 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00592 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236568 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236568 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00231344 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00631274 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00231123 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00231123 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023343 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00642286 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233077 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00233077 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00284612 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621295 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00281985 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00281985 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240328 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614057 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238171 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238171 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239977 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0070302 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267463 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239977 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.002329 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00631632 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232501 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00232501 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235369 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0061379 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00245145 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235369 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234447 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00623562 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236223 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234447 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(2400,800,1,40,20) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251886 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595164 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249821 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249821 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239886 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597943 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239672 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239672 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00232774 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00623523 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00230975 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00230975 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00243262 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00634156 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235683 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235683 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00281188 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604914 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00282048 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00281188 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239413 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591817 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239177 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239177 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00244788 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00582894 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00244455 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00244455 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023668 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608876 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234702 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234702 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235893 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603848 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234919 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234919 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237122 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606286 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237295 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237122 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(600,200,1:4,10,5) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252351 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00581266 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254236 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00252351 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239642 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00587611 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242379 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239642 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233681 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599562 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023689 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00233681 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024908 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00617314 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240328 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240328 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00273673 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060179 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00275024 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00273673 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00241471 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619619 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241905 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00241471 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248158 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601448 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00246983 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00246983 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235878 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236305 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235878 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238438 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00655377 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236867 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236867 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235721 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598781 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236882 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235721 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(120,40,40:32,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253666 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601619 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253466 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00253466 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00238712 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613848 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238255 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00238255 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248568 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00680294 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00262026 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00248568 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00253265 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00680795 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249584 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249584 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00282568 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00754478 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283097 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00282568 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023837 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614648 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00247204 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0023837 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00250747 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00670982 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251693 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00250747 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00256849 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00667948 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252848 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252848 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00251461 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0068665 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252006 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00251461 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00257723 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00685061 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00253305 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00253305 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Float(800,1:4,40,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00258245 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00671377 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00261752 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00258245 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0023725 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00662109 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235953 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235953 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247165 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00590647 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232597 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00232597 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235751 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00719474 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236395 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235751 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00291474 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613619 [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00286747 [04/18/2023-18:31:45] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00286747 [04/18/2023-18:31:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:45] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:45] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:45] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234492 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00650182 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234439 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234439 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236852 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00622589 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236305 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236305 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00232199 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00631871 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00231373 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00231373 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00231344 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00623662 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232546 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00231344 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00231919 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00625888 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233261 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00231919 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(2400,800,40,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00244401 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630519 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243897 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00243897 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237857 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598229 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00238583 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00237857 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233711 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600667 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233607 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00233607 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236755 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00605924 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237107 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00236755 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00286254 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00603486 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00287918 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00286254 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234769 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619467 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236605 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234769 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234649 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006132 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00234394 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00234394 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235608 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616857 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.002384 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235608 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00231617 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610362 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232206 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00231617 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239284 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606914 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241501 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239284 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(1200,400,40:2,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00252391 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599391 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00269775 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00252391 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024077 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00598286 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241524 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0024077 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00232081 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00601676 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232568 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00232081 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235219 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612076 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00242596 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00235219 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00284316 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00588361 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00281672 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00281672 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00237422 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060179 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237092 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237092 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239741 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600724 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239208 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239208 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234477 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619047 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00231329 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00231329 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00231381 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0061019 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00231764 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00231381 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00233489 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613257 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233917 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00233489 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(360,120,1:8,6,3) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248623 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608438 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00251909 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00248623 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00247638 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060741 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240046 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240046 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00231926 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233711 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00231926 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00236133 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00630161 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235721 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235721 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0028411 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608514 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00288293 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0028411 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00243533 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00620095 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239726 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239726 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0024093 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00616076 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239688 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239688 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00232317 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00634832 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00231639 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00231639 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00232332 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629466 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233924 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00232332 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234657 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00625709 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237849 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234657 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(240,80,1:16,4,2) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00249442 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00604914 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254645 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00249442 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242232 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00591342 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00241532 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00241532 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00232774 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00589495 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023085 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0023085 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00240678 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00625352 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236508 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236508 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00282658 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00586789 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00281537 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00281537 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239749 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006132 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00237759 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00237759 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00242999 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00600933 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00240404 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00240404 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00231344 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607676 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00231668 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00231344 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00235938 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00595346 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00232236 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00232236 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00234267 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00796343 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00375045 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00234267 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(120,40,40:32,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0034708 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102645 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00368551 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0034708 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0032128 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102929 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00324074 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0032128 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00321453 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0113544 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00333555 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00321453 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00331647 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.01159 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00342618 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00331647 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00332566 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115126 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00342465 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00332566 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00321676 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100413 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00336787 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00321676 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325216 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0130622 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00351721 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00325216 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00325548 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118407 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00341693 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00325548 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00327314 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0108578 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00342999 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00327314 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00338509 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0117472 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345698 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00338509 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(800,1:8,40,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00331034 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0118024 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00339232 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00331034 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00312268 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0102772 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00325881 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00312268 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00328821 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115341 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00335989 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00328821 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00330171 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0116332 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347189 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00330171 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00364286 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0122088 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00353606 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00353606 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00334724 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0100465 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00337658 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00334724 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00332853 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0115298 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00310186 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00310186 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00320985 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0119375 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249963 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00249963 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00278312 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0114943 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00308766 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00278312 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00345056 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0111838 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0035384 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00345056 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(800,800:32,40,2,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Mul_5_output_0 copy (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00307686 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.013935 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00333108 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00307686 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00312149 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00995291 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0031869 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00312149 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00323007 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.008224 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00322804 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00322804 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0162865 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00731634 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0163921 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00731634 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00333523 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606133 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00289289 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00289289 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0035824 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.006048 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00356248 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00356248 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1700,85,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00858944 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00597848 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00859025 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00597848 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00319329 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00698079 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00335043 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00319329 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0165176 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0069895 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0164648 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0069895 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00321006 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619695 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00320244 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00320244 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00352078 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00611924 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00350517 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00350517 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(102000,34000,1,1700,20) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00918886 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607105 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00919657 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00607105 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00322448 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00691004 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00323302 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00322448 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0164333 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00705437 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0164455 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00705437 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344229 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00638728 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345622 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00344229 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00372841 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00634395 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00373826 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00372841 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(25500,8500,1:4,425,5) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00919314 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00620114 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00918229 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00620114 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00322326 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00691657 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00320894 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00320894 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344522 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00691396 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0034289 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0034289 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00343913 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612571 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00343325 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00343325 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00373357 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606324 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00374588 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00373357 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(5100,1700,1700:32,85,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.009452 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00608838 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00942457 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00608838 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00317138 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00612305 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00314146 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00314146 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0032826 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00627578 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00325932 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00325932 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0161239 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00624059 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0160422 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00624059 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00318141 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00639583 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00298467 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00298467 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00356014 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00635945 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00349491 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00349491 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(102000,34000,1700,85,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00857815 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00639563 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00855556 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00639563 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00329538 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00599886 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00326099 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00326099 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00348521 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606933 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00344261 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00344261 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0163053 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00613676 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0163967 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00613676 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00337765 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0063034 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00340223 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00337765 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00364114 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621853 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00363394 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00363394 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(51000,17000,1700:2,85,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00701497 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621674 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00703891 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00621674 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326992 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00620267 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00326587 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00326587 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344457 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629267 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00343946 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00343946 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0165343 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610552 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0165298 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00610552 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00364309 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00638668 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00362274 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00362274 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(25500,8500,1:4,425,5) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00908943 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00628512 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00912686 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00628512 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00327875 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00607543 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00327429 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00327429 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00348577 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00619809 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00345197 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00345197 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0164871 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610343 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0164871 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00610343 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00335341 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00634296 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00335171 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00335171 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00361463 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00632487 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0036272 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00361463 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(15300,5100,1:8,255,3) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00916971 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00634534 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00918629 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00634534 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00333225 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00610076 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00332524 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00332524 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00350417 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00618343 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00346852 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00346852 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0164825 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00628909 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0164764 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00628909 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00344697 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00642246 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334607 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00334607 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(10200,3400,1:16,170,2) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00918857 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0062231 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00917286 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.0062231 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00326005 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00606648 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.003256 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.003256 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00345557 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0060739 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00344631 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00344631 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.016477 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00639245 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0165125 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003ea Time: 0.00639245 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033432 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00629804 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00334788 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0033432 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(5100,1700,1700:32,85,1) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(/model.77/Concat_2_output_0 -> ) (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00362011 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00622469 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00402108 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00362011 [04/18/2023-18:31:46] [V] [TRT] =============== Computing reformatting costs: [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(102000,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5_copy_output (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00248402 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00614514 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00249159 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00248402 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(1,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5_copy_output (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00254813 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00584137 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00255118 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00254813 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(1:4,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5_copy_output (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0033314 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0437566 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00333459 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0033314 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Float(102000:32,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5_copy_output (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.0084238 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0444709 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00844988 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.0084238 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(102000,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5_copy_output (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00239779 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.00621333 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00258155 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00239779 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(102000:2,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5_copy_output (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00331075 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0158427 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00323393 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00323393 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(1:4,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5_copy_output (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00323342 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0158487 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00319279 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00319279 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(1:8,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5_copy_output (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00332566 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0158519 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00335341 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x00000000000003e8 Time: 0.00332566 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(1:16,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5_copy_output (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00407708 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0159137 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00407657 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00407657 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning Reformat: Half(102000:32,85,1) -> Float(2142000,85,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5_copy_output (Reformat) [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00712882 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0166629 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00711663 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00711663 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [04/18/2023-18:31:46] [V] [TRT] =============== Computing costs for [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning format combination: -> Float(12800,12800,160,2,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning format combination: -> Half(12800,12800,160,2,1) *************** [04/18/2023-18:31:46] [V] [TRT] =============== Computing costs for [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning format combination: -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning format combination: -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:46] [V] [TRT] =============== Computing costs for [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning format combination: -> Float(3200,3200,80,2,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning format combination: -> Half(3200,3200,80,2,1) *************** [04/18/2023-18:31:46] [V] [TRT] =============== Computing costs for [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning format combination: -> Float(6,2,2,2,1) *************** [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning format combination: -> Half(6,2,2,2,1) *************** [04/18/2023-18:31:46] [V] [TRT] =============== Computing costs for [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning format combination: Int8(409600,409600:4,640,1) -> Float(3276800,102400,320,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv (CudaDepthwiseConvolution) [04/18/2023-18:31:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv (CaskFlattenConvolution) [04/18/2023-18:31:46] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv (CaskConvolution) [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 Tactic: 0x127de12a1f1a4809 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x127de12a1f1a4809 Time: 0.111168 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.0725577 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.0390994 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.0301056 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-18:31:46] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0372663 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.0724046 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0360777 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 Tactic: 0x1b0534177b414e71 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x1b0534177b414e71 Time: 0.0473234 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.0388023 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-18:31:46] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.0303479 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0xfe80445f7bb61a99 Time: 0.0301056 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xfe80445f7bb61a99 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning format combination: Int8(409600,409600:32,640,1) -> Float(3276800,102400,320,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv (CaskFlattenConvolution) [04/18/2023-18:31:46] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv (CaskConvolution) [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x2bcbba39f608bf10 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x2bcbba39f608bf10 Time: 0.0590507 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x85c1a5f7f239cf84 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x85c1a5f7f239cf84 Time: 0.0557181 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0xac914b235d066808 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0xac914b235d066808 Time: 0.09704 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0xa8b56a226b057463 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0xa8b56a226b057463 Time: 0.0481829 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x64x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x23b890da05937b9e [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x23b890da05937b9e Time: 0.0548571 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0xa8b56a226b057463 Time: 0.0481829 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa8b56a226b057463 [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning format combination: Int8(409600,409600:32,640,1) -> Float(102400,102400:32,320,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv (CaskFlattenConvolution) [04/18/2023-18:31:46] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv (CaskConvolution) [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x45f7566cdb2b10fb [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x45f7566cdb2b10fb Time: 0.0700465 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-18:31:46] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.0576411 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xea2b7420057a01c1 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0xea2b7420057a01c1 Time: 0.114688 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.0480869 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x2d8ab2aa0639fda9 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x2d8ab2aa0639fda9 Time: 0.0492343 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd14bd6d95fefd45e [04/18/2023-18:31:46] [V] [TRT] Tactic: 0xd14bd6d95fefd45e Time: 0.0693699 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.0709257 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.0549897 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.0847726 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x0e07dc8353bf7e9f [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0e07dc8353bf7e9f Time: 0.0627581 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x55edef142e02adaa [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x55edef142e02adaa Time: 0.0704122 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.11747 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.0736549 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x0edd5d0285e564d4 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x0edd5d0285e564d4 Time: 0.080432 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xb936321f82fd390c [04/18/2023-18:31:46] [V] [TRT] Tactic: 0xb936321f82fd390c Time: 0.0449097 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.0465189 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.069725 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xad886d4d69834922 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0xad886d4d69834922 Time: 0.052029 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0784091 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x47b1629a4bff4800 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x47b1629a4bff4800 Time: 0.078192 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.0517364 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.0608061 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.0636297 [04/18/2023-18:31:46] [V] [TRT] Fastest Tactic: 0xb936321f82fd390c Time: 0.0449097 [04/18/2023-18:31:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xb936321f82fd390c [04/18/2023-18:31:46] [V] [TRT] *************** Autotuning format combination: Int8(409600,409600:32,640,1) -> Half(102400,102400:32,320,1) *************** [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv (CaskFlattenConvolution) [04/18/2023-18:31:46] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:46] [V] [TRT] --------------- Timing Runner: model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv (CaskConvolution) [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5812ced7874b44d1 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x5812ced7874b44d1 Time: 0.0517211 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x43e3804f158e597d [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x43e3804f158e597d Time: 0.0715337 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x264d83735b1cba13 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x264d83735b1cba13 Time: 0.0551375 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3e116db8858d0d41 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x3e116db8858d0d41 Time: 0.085488 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x8f07802f58d278c0 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x8f07802f58d278c0 Time: 0.117321 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x4133eb8759ee0d6d [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x4133eb8759ee0d6d Time: 0.0492983 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xad6872a374321f7e [04/18/2023-18:31:46] [V] [TRT] Tactic: 0xad6872a374321f7e Time: 0.0471406 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xccdb99df0646c7b3 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0xccdb99df0646c7b3 Time: 0.0701684 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xc5159665a920f22c [04/18/2023-18:31:46] [V] [TRT] Tactic: 0xc5159665a920f22c Time: 0.0695345 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xd7985d83133bcf37 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0xd7985d83133bcf37 Time: 0.0433074 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x45aada088ffff645 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x45aada088ffff645 Time: 0.114661 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xfa6c413ca4875a2e [04/18/2023-18:31:46] [V] [TRT] Tactic: 0xfa6c413ca4875a2e Time: 0.0702248 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x39d4f216f0f6dbdb [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x39d4f216f0f6dbdb Time: 0.0426057 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xe830ccb2c17abf84 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0xe830ccb2c17abf84 Time: 0.0714606 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x51a916d02de43689 [04/18/2023-18:31:46] [V] [TRT] Tactic: 0x51a916d02de43689 Time: 0.0692419 [04/18/2023-18:31:46] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x4e7f02f91ddf4673 [04/18/2023-18:31:47] [V] [TRT] Tactic: 0x4e7f02f91ddf4673 Time: 0.0740206 [04/18/2023-18:31:47] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xaceaca2c82ab40f3 [04/18/2023-18:31:47] [V] [TRT] Tactic: 0xaceaca2c82ab40f3 Time: 0.0693394 [04/18/2023-18:31:47] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xe266dbc8b588209b [04/18/2023-18:31:47] [V] [TRT] Tactic: 0xe266dbc8b588209b Time: 0.0807314 [04/18/2023-18:31:47] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb7a90e7097d64877 [04/18/2023-18:31:47] [V] [TRT] Tactic: 0xb7a90e7097d64877 Time: 0.0499764 [04/18/2023-18:31:47] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xe2bc5a4963d23ad0 [04/18/2023-18:31:47] [V] [TRT] Tactic: 0xe2bc5a4963d23ad0 Time: 0.0549547 [04/18/2023-18:31:47] [V] [TRT] Fastest Tactic: 0x39d4f216f0f6dbdb Time: 0.0426057 [04/18/2023-18:31:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x39d4f216f0f6dbdb [04/18/2023-18:31:47] [V] [TRT] =============== Computing costs for [04/18/2023-18:31:47] [V] [TRT] *************** Autotuning format combination: Float(3276800,102400,320,1) -> Int8(3276800,102400,320,1) *************** [04/18/2023-18:31:47] [V] [TRT] --------------- Timing Runner: PWN(/model.0/act/LeakyRelu) (PointWiseV2) [04/18/2023-18:31:47] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0304997 [04/18/2023-18:31:47] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0271497 [04/18/2023-18:31:47] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0266149 [04/18/2023-18:31:47] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.026861 [04/18/2023-18:31:47] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0264046 [04/18/2023-18:31:48] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0263093 [04/18/2023-18:31:48] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0287835 [04/18/2023-18:31:48] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0266971 [04/18/2023-18:31:48] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0264274 [04/18/2023-18:31:48] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0265554 [04/18/2023-18:31:48] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0313051 [04/18/2023-18:31:48] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.0263093 [04/18/2023-18:31:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [04/18/2023-18:31:48] [V] [TRT] *************** Autotuning format combination: Float(102400,102400:32,320,1) -> Int8(102400,102400:32,320,1) *************** [04/18/2023-18:31:48] [V] [TRT] --------------- Timing Runner: PWN(/model.0/act/LeakyRelu) (PointWiseV2) [04/18/2023-18:31:49] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0268686 [04/18/2023-18:31:49] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0271627 [04/18/2023-18:31:49] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0276251 [04/18/2023-18:31:49] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0275261 [04/18/2023-18:31:49] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0275749 [04/18/2023-18:31:50] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0290496 [04/18/2023-18:31:50] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0274309 [04/18/2023-18:31:50] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0288155 [04/18/2023-18:31:50] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0307301 [04/18/2023-18:31:51] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0320073 [04/18/2023-18:31:51] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0270141 [04/18/2023-18:31:51] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0272373 [04/18/2023-18:31:51] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0275756 [04/18/2023-18:31:51] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.027328 [04/18/2023-18:31:52] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0268678 [04/18/2023-18:31:52] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0267901 [04/18/2023-18:31:52] [V] [TRT] Tactic: 0x000000000000001a Time: 0.027696 [04/18/2023-18:31:52] [V] [TRT] Tactic: 0x000000000000001b Time: 0.029952 [04/18/2023-18:31:52] [V] [TRT] Tactic: 0x000000000000001d Time: 0.027869 [04/18/2023-18:31:52] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0271771 [04/18/2023-18:31:53] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0267962 [04/18/2023-18:31:53] [V] [TRT] Fastest Tactic: 0x0000000000000019 Time: 0.0267901 [04/18/2023-18:31:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000019 [04/18/2023-18:31:53] [V] [TRT] *************** Autotuning format combination: Half(3276800,102400,320,1) -> Int8(3276800,102400,320,1) *************** [04/18/2023-18:31:53] [V] [TRT] --------------- Timing Runner: PWN(/model.0/act/LeakyRelu) (PointWiseV2) [04/18/2023-18:31:53] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0327717 [04/18/2023-18:31:53] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0255269 [04/18/2023-18:31:53] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0205427 [04/18/2023-18:31:53] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0226736 [04/18/2023-18:31:53] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0186549 [04/18/2023-18:31:54] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0175898 [04/18/2023-18:31:54] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0226978 [04/18/2023-18:31:54] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0194514 [04/18/2023-18:31:54] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0164363 [04/18/2023-18:31:54] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0175228 [04/18/2023-18:31:54] [V] [TRT] Tactic: 0x000000000000001c Time: 0.03072 [04/18/2023-18:31:54] [V] [TRT] Fastest Tactic: 0x0000000000000008 Time: 0.0164363 [04/18/2023-18:31:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000008 [04/18/2023-18:31:54] [V] [TRT] *************** Autotuning format combination: Half(102400,102400:32,320,1) -> Int8(102400,102400:32,320,1) *************** [04/18/2023-18:31:54] [V] [TRT] --------------- Timing Runner: PWN(/model.0/act/LeakyRelu) (PointWiseV2) [04/18/2023-18:31:55] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0163677 [04/18/2023-18:31:55] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0171317 [04/18/2023-18:31:55] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0171967 [04/18/2023-18:31:55] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0170895 [04/18/2023-18:31:55] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0189457 [04/18/2023-18:31:56] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0185977 [04/18/2023-18:31:56] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0174573 [04/18/2023-18:31:56] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0184943 [04/18/2023-18:31:56] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0190514 [04/18/2023-18:31:57] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0229564 [04/18/2023-18:31:57] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0176655 [04/18/2023-18:31:57] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0170362 [04/18/2023-18:31:57] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0200177 [04/18/2023-18:31:57] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0167736 [04/18/2023-18:31:58] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0184126 [04/18/2023-18:31:58] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0174776 [04/18/2023-18:31:58] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0182269 [04/18/2023-18:31:58] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0196337 [04/18/2023-18:31:58] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0226325 [04/18/2023-18:31:58] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0186354 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0175543 [04/18/2023-18:31:59] [V] [TRT] Fastest Tactic: 0x000000000000000a Time: 0.0163677 [04/18/2023-18:31:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000000a [04/18/2023-18:31:59] [V] [TRT] =============== Computing costs for [04/18/2023-18:31:59] [V] [TRT] *************** Autotuning format combination: Int8(3276800,102400,320,1) -> Int8(1638400,25600,160,1) *************** [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:31:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:31:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] *************** Autotuning format combination: Int8(819200,102400:4,320,1) -> Int8(409600,25600:4,160,1) *************** [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:31:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:31:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:31:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:31:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] *************** Autotuning format combination: Int8(819200,102400:4,320,1) -> Int8(51200,25600:32,160,1) *************** [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:31:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:31:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] *************** Autotuning format combination: Int8(102400,102400:32,320,1) -> Int8(51200,25600:32,160,1) *************** [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:31:59] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:31:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:31:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:31:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.0267109 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0278453 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0251741 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.0251208 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.0265996 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.0178589 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.019008 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.0287013 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0301275 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0201811 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0348727 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.0191183 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.021086 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0353134 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0337271 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0277943 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0228833 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0555886 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0564663 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0242187 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0330249 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0232666 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0344101 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.0234893 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0309339 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0335579 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0571977 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.03968 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0213316 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.0191886 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.028109 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0226893 [04/18/2023-18:31:59] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0218658 [04/18/2023-18:31:59] [V] [TRT] Fastest Tactic: 0xa085d13614221ec4 Time: 0.0178589 [04/18/2023-18:31:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa085d13614221ec4 [04/18/2023-18:31:59] [V] [TRT] =============== Computing costs for [04/18/2023-18:31:59] [V] [TRT] *************** Autotuning format combination: Int8(1638400,25600,160,1) -> Int8(3276800,25600,160,1) long-strided *************** [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:31:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:31:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] *************** Autotuning format combination: Int8(1638400,25600,160,1) -> Int8(819200,25600,160,1) *************** [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:31:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:31:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] *************** Autotuning format combination: Int8(409600,25600:4,160,1) -> Int8(819200,25600:4,160,1) long-strided *************** [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:31:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:31:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:31:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:31:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] *************** Autotuning format combination: Int8(409600,25600:4,160,1) -> Int8(102400,25600:32,160,1) long-strided *************** [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:31:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:31:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] *************** Autotuning format combination: Int8(409600,25600:4,160,1) -> Int8(204800,25600:4,160,1) *************** [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:31:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:31:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:31:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:31:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] *************** Autotuning format combination: Int8(409600,25600:4,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:31:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:31:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] *************** Autotuning format combination: Int8(51200,25600:32,160,1) -> Int8(102400,25600:32,160,1) long-strided *************** [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:31:59] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:31:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:31:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:31:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.0125032 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.0124899 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0129181 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.009182 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0100596 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.0146875 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.0103167 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.0115566 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.016477 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0183697 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.0110748 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0127261 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0326592 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00809702 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.0087282 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.0137247 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00875375 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.0226501 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.0216522 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0230158 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0335579 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00979383 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.012565 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00985448 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00903772 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0341138 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00894629 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0181171 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0146025 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0204173 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.017341 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0124632 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.012024 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.0127844 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0201663 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0345755 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0258644 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0123897 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.0111349 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0153033 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0207236 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0191709 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0146661 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.014245 [04/18/2023-18:31:59] [V] [TRT] Fastest Tactic: 0x3321b9c38b0ba08d Time: 0.00809702 [04/18/2023-18:31:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:31:59] [V] [TRT] *************** Autotuning format combination: Int8(51200,25600:32,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:31:59] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:31:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:31:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:31:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:31:59] [V] [TRT] --------------- Timing Runner: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.0123737 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.0125383 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0128019 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00918143 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0100355 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.0147003 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.0103242 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.0115218 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.0164963 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0183566 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.0110643 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0125806 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0325641 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00808508 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00876397 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.0134296 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.0087559 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.0225404 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.0215876 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0229923 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0334711 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00978499 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.0125562 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00994103 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00904457 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0341202 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00899372 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0181394 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0146021 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0200697 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.0173374 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0125185 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.0120088 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.0127646 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0199657 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0346213 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0258202 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:31:59] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0124076 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.0108624 [04/18/2023-18:31:59] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:31:59] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0152101 [04/18/2023-18:32:00] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0197486 [04/18/2023-18:32:00] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0190103 [04/18/2023-18:32:00] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0146633 [04/18/2023-18:32:00] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.0142446 [04/18/2023-18:32:00] [V] [TRT] Fastest Tactic: 0x3321b9c38b0ba08d Time: 0.00808508 [04/18/2023-18:32:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:32:00] [V] [TRT] =============== Computing costs for [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(1638400,25600,160,1) -> Int8(819200,25600,160,1) *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear + /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear + /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(409600,25600:4,160,1) -> Int8(204800,25600:4,160,1) *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear + /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear + /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:32:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear + /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear + /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(409600,25600:4,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear + /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear + /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(51200,25600:32,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-18:32:00] [V] [TRT] =============== Computing costs for [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(819200,25600,160,1) -> Int8(819200,25600,160,1) *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(204800,25600:4,160,1) -> Int8(204800,25600:4,160,1) *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:32:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(204800,25600:4,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(25600,25600:32,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:32:00] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:32:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.0215066 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0218834 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0147287 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.0216862 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.0230962 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.0154894 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.0167929 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.0279101 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0292864 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0193829 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0329435 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.0179429 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.0113927 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0339968 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0294994 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0167741 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0123284 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0536335 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0552472 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0129707 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0326766 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0213218 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0301605 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.0139703 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0216718 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0298048 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0558324 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0384434 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.020898 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.0181251 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0273036 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0201326 [04/18/2023-18:32:00] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0191851 [04/18/2023-18:32:00] [V] [TRT] Fastest Tactic: 0xb35096a016bb733a Time: 0.0113927 [04/18/2023-18:32:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xb35096a016bb733a [04/18/2023-18:32:00] [V] [TRT] =============== Computing costs for [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(819200,25600,160,1) -> Int8(3276800,25600,160,1) long-strided *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(819200,25600,160,1) -> Int8(819200,25600,160,1) *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(204800,25600:4,160,1) -> Int8(819200,25600:4,160,1) long-strided *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:32:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(204800,25600:4,160,1) -> Int8(102400,25600:32,160,1) long-strided *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(204800,25600:4,160,1) -> Int8(204800,25600:4,160,1) *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:32:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(204800,25600:4,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(25600,25600:32,160,1) -> Int8(102400,25600:32,160,1) long-strided *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:32:00] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:32:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.0215876 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0218116 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0147456 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.0216953 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.0230903 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.0154597 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.0168391 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.027843 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0293029 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0193343 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0329179 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.0179126 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.0113916 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0339776 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0294546 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0167436 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0123032 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0535893 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0544838 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0129707 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.032907 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0212715 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0301934 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.0140064 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.021649 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0297838 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0557836 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0384343 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0208588 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.0181617 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0272891 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0200994 [04/18/2023-18:32:00] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0192354 [04/18/2023-18:32:00] [V] [TRT] Fastest Tactic: 0xb35096a016bb733a Time: 0.0113916 [04/18/2023-18:32:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xb35096a016bb733a [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(25600,25600:32,160,1) -> Int8(25600,25600:32,160,1) *************** [04/18/2023-18:32:00] [V] [TRT] =============== Computing costs for [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(3276800,25600,160,1) -> Int8(1638400,25600,160,1) *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(819200,25600:4,160,1) -> Int8(409600,25600:4,160,1) *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:32:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(819200,25600:4,160,1) -> Int8(51200,25600:32,160,1) *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(102400,25600:32,160,1) -> Int8(51200,25600:32,160,1) *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:32:00] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:32:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.0164851 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.0169854 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0186337 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.0163967 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0181663 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.0173836 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.0124213 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.0141232 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.0198217 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0216535 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.0133694 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.014891 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0389851 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.0151831 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.0166776 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.0168711 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.015323 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.0269112 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.0258598 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0271787 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0400709 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.0121177 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.0151904 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0182309 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0170667 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.040448 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0168061 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0215667 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0181577 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0262049 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.0205871 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0200223 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.0142284 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.0154935 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0260579 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0409966 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0304183 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0147118 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.0136648 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0185223 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0258926 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0250705 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0182177 [04/18/2023-18:32:00] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.0177544 [04/18/2023-18:32:00] [V] [TRT] Fastest Tactic: 0x0779fa4ac8f9f2ee Time: 0.0121177 [04/18/2023-18:32:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:32:00] [V] [TRT] =============== Computing costs for [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(409600,25600:4,160,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: /model.8/m/MaxPool (TiledPooling) [04/18/2023-18:32:00] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: /model.8/m/MaxPool (CudaPooling) [04/18/2023-18:32:00] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: /model.8/m/MaxPool (CaskPooling) [04/18/2023-18:32:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_CHWPacked_NCxHW4_kMAX Tactic: 0x1f6c40e3e09ec730 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x1f6c40e3e09ec730 Time: 0.00492784 [04/18/2023-18:32:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll6_tThreads256 Tactic: 0xec7cf487c5e61cec [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xec7cf487c5e61cec Time: 0.00626067 [04/18/2023-18:32:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll5_tThreads256 Tactic: 0x185e4d2f4b6d969e [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x185e4d2f4b6d969e Time: 0.00696991 [04/18/2023-18:32:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll8_tThreads128 Tactic: 0xa492ee81d8eb5052 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xa492ee81d8eb5052 Time: 0.0057781 [04/18/2023-18:32:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll3_tThreads256 Tactic: 0x62c39155f9749cff [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x62c39155f9749cff Time: 0.00602552 [04/18/2023-18:32:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll2_tThreads256 Tactic: 0xbf6a632b19f7ef52 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xbf6a632b19f7ef52 Time: 0.00593573 [04/18/2023-18:32:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll6_tThreads128 Tactic: 0x78221da2d2d1bd4f [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x78221da2d2d1bd4f Time: 0.00587868 [04/18/2023-18:32:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll2_tThreads128 Tactic: 0x2b348a0e0ec04ef1 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x2b348a0e0ec04ef1 Time: 0.00546895 [04/18/2023-18:32:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll3_tThreads128 Tactic: 0xf69d7870ee433d5c [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xf69d7870ee433d5c Time: 0.00558699 [04/18/2023-18:32:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll4_tThreads128 Tactic: 0x51a95674bcd94490 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x51a95674bcd94490 Time: 0.00610857 [04/18/2023-18:32:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll7_tThreads256 Tactic: 0x31d506f925656f41 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x31d506f925656f41 Time: 0.00677091 [04/18/2023-18:32:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll8_tThreads256 Tactic: 0x30cc07a4cfdcf1f1 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x30cc07a4cfdcf1f1 Time: 0.00592037 [04/18/2023-18:32:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll1_tThreads128 Tactic: 0xdf1633a6804bc483 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xdf1633a6804bc483 Time: 0.00603276 [04/18/2023-18:32:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll7_tThreads128 Tactic: 0xa58befdc3252cee2 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xa58befdc3252cee2 Time: 0.00625371 [04/18/2023-18:32:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll1_tThreads256 Tactic: 0x4b48da83977c6520 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x4b48da83977c6520 Time: 0.00704784 [04/18/2023-18:32:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll4_tThreads256 Tactic: 0xc5f7bf51abeee533 [04/18/2023-18:32:00] [V] [TRT] Tactic: 0xc5f7bf51abeee533 Time: 0.00653964 [04/18/2023-18:32:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_INT8NCxHW4_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll5_tThreads128 Tactic: 0x8c00a40a5c5a373d [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x8c00a40a5c5a373d Time: 0.00658535 [04/18/2023-18:32:00] [V] [TRT] Fastest Tactic: 0x1f6c40e3e09ec730 Time: 0.00492784 [04/18/2023-18:32:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x1f6c40e3e09ec730 [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(51200,25600:32,160,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: /model.8/m/MaxPool (TiledPooling) [04/18/2023-18:32:00] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: /model.8/m/MaxPool (CudaPooling) [04/18/2023-18:32:00] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: /model.8/m/MaxPool (CaskPooling) [04/18/2023-18:32:00] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm72_xmma_pooling_IMMA_NCxHW32_generic_kMAX Tactic: 0x94215b398b8eb3ba [04/18/2023-18:32:00] [V] [TRT] Tactic: 0x94215b398b8eb3ba Time: 0.00482895 [04/18/2023-18:32:00] [V] [TRT] Fastest Tactic: 0x94215b398b8eb3ba Time: 0.00482895 [04/18/2023-18:32:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x94215b398b8eb3ba [04/18/2023-18:32:00] [V] [TRT] =============== Computing costs for [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(409600,6400,80,1) -> Int8(1638400,6400,80,1) long-strided *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(409600,6400,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(409600,6400:4,80,1) long-strided *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:32:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(51200,6400:32,80,1) long-strided *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:32:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] *************** Autotuning format combination: Int8(12800,6400:32,80,1) -> Int8(51200,6400:32,80,1) long-strided *************** [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:32:00] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:32:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:00] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00662317 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00680533 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00767134 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00648387 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00681992 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00715086 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.0057004 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00597638 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00705502 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00789462 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00544372 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0057792 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0108242 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00549785 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00593865 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00783182 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00612914 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.00852249 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00824051 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00880538 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0109915 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.0055469 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00639583 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00664187 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00601295 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0112049 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00581358 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00747954 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00827581 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.00991147 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00731108 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00708093 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00565767 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00661777 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.00982065 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0111771 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00928486 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00560721 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00570637 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0070265 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.00969234 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.009338 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00847919 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00807137 [04/18/2023-18:32:01] [V] [TRT] Fastest Tactic: 0x25bf7139bbd93bc8 Time: 0.00544372 [04/18/2023-18:32:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:32:01] [V] [TRT] *************** Autotuning format combination: Int8(12800,6400:32,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:32:01] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:32:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00655709 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.0068054 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00734377 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00645704 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00695118 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00712055 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00567666 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00598229 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00708376 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00763092 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00540055 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00578322 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.010799 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00543966 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00580297 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.007712 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00611847 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.00999741 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.010782 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00859697 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.011014 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00555745 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00636939 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00665891 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00600648 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0111613 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00583497 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00747291 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00826692 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0099459 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.0072896 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00709203 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00564325 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00659221 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.00985112 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.011162 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.009274 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00560018 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00568457 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0070548 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0097277 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.00931886 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00850339 [04/18/2023-18:32:01] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00808025 [04/18/2023-18:32:01] [V] [TRT] Fastest Tactic: 0x25bf7139bbd93bc8 Time: 0.00540055 [04/18/2023-18:32:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:32:01] [V] [TRT] =============== Computing costs for [04/18/2023-18:32:01] [V] [TRT] *************** Autotuning format combination: Int8(409600,6400,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear + /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear + /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear + /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear + /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:32:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear + /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear + /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear + /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear + /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] *************** Autotuning format combination: Int8(12800,6400:32,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:32:01] [V] [TRT] =============== Computing costs for [04/18/2023-18:32:01] [V] [TRT] *************** Autotuning format combination: Int8(409600,6400,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:32:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] *************** Autotuning format combination: Int8(12800,6400:32,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:32:01] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:32:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.013184 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0139063 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0114064 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.0129528 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.0132488 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.00917172 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00962286 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.0134196 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0137812 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00847408 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0136578 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.00830019 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.00834311 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0135958 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0196571 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0120971 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00891375 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0208307 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0211442 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00956343 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0143653 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0148197 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0200903 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.0107177 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0143863 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0200051 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0213322 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0148768 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00886185 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00962408 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0131391 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.013723 [04/18/2023-18:32:01] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0131466 [04/18/2023-18:32:01] [V] [TRT] Fastest Tactic: 0xfbcd5a1da537e27f Time: 0.00830019 [04/18/2023-18:32:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xfbcd5a1da537e27f [04/18/2023-18:32:01] [V] [TRT] =============== Computing costs for [04/18/2023-18:32:01] [V] [TRT] *************** Autotuning format combination: Int8(409600,6400,80,1) -> Int8(1638400,6400,80,1) long-strided *************** [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] *************** Autotuning format combination: Int8(409600,6400,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(409600,6400:4,80,1) long-strided *************** [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:32:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(51200,6400:32,80,1) long-strided *************** [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:32:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] *************** Autotuning format combination: Int8(12800,6400:32,80,1) -> Int8(51200,6400:32,80,1) long-strided *************** [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:32:01] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:32:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.0131682 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0139129 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0112995 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.012869 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.0132588 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.00906714 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00958842 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.0133141 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0136495 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00846413 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0133935 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.008272 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.00835403 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.013632 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0196703 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0121048 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00888632 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0207726 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.021154 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00956739 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0144023 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0148439 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0201154 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.0107781 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0144384 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0200411 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0213283 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0148841 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00888471 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.0096384 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0131258 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0137608 [04/18/2023-18:32:01] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-18:32:01] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0131283 [04/18/2023-18:32:01] [V] [TRT] Fastest Tactic: 0xfbcd5a1da537e27f Time: 0.008272 [04/18/2023-18:32:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xfbcd5a1da537e27f [04/18/2023-18:32:01] [V] [TRT] *************** Autotuning format combination: Int8(12800,6400:32,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:32:01] [V] [TRT] =============== Computing costs for [04/18/2023-18:32:01] [V] [TRT] *************** Autotuning format combination: Int8(409600,6400:4,80,1) -> Float(819200,6400,80,1) *************** [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:01] [V] [TRT] --------------- Timing Runner: model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:01] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 0xc25454de2efcccdc [04/18/2023-18:32:02] [V] [TRT] Tactic: 0xc25454de2efcccdc Time: 0.0241128 [04/18/2023-18:32:02] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: 0xff6944b17d5b2e32 [04/18/2023-18:32:02] [V] [TRT] Tactic: 0xff6944b17d5b2e32 Time: 0.0239665 [04/18/2023-18:32:02] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-18:32:02] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.0242042 [04/18/2023-18:32:02] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-18:32:02] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.02512 [04/18/2023-18:32:02] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-18:32:02] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.0252556 [04/18/2023-18:32:02] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-18:32:02] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0244381 [04/18/2023-18:32:02] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-18:32:02] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.0242834 [04/18/2023-18:32:02] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-18:32:02] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0241539 [04/18/2023-18:32:02] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 0x1db6e8cf1382fbe0 [04/18/2023-18:32:02] [V] [TRT] Tactic: 0x1db6e8cf1382fbe0 Time: 0.0239916 [04/18/2023-18:32:02] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: 0xa4ae2d82115c3e83 [04/18/2023-18:32:02] [V] [TRT] Tactic: 0xa4ae2d82115c3e83 Time: 0.024064 [04/18/2023-18:32:02] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-18:32:02] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.0248922 [04/18/2023-18:32:02] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-18:32:02] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.0255185 [04/18/2023-18:32:02] [V] [TRT] Fastest Tactic: 0xff6944b17d5b2e32 Time: 0.0239665 [04/18/2023-18:32:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xff6944b17d5b2e32 [04/18/2023-18:32:02] [V] [TRT] *************** Autotuning format combination: Int8(51200,6400:32,80,1) -> Float(819200,6400,80,1) *************** [04/18/2023-18:32:02] [V] [TRT] --------------- Timing Runner: model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:02] [V] [TRT] --------------- Timing Runner: model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:02] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x733ba2a91a48d431 [04/18/2023-18:32:02] [V] [TRT] Tactic: 0x733ba2a91a48d431 Time: 0.0195109 [04/18/2023-18:32:02] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0xf04572b287451f42 [04/18/2023-18:32:02] [V] [TRT] Tactic: 0xf04572b287451f42 Time: 0.0216496 [04/18/2023-18:32:02] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-18:32:02] [V] [TRT] Tactic: 0x5e4f6d7c83746fd6 Time: 0.022046 [04/18/2023-18:32:02] [V] [TRT] Fastest Tactic: 0x733ba2a91a48d431 Time: 0.0195109 [04/18/2023-18:32:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x733ba2a91a48d431 [04/18/2023-18:32:02] [V] [TRT] *************** Autotuning format combination: Int8(51200,6400:32,80,1) -> Float(25600,6400:32,80,1) *************** [04/18/2023-18:32:30] [V] [TRT] --------------- Timing Runner: model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) (CaskJitConv) [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xc22b2f91e37e472a [04/18/2023-18:32:30] [V] [TRT] Tactic: 0xc22b2f91e37e472a Time: 0.0133839 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x716fcb85e712b30e [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x716fcb85e712b30e Time: 0.0165567 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x5e4918ccf433630e [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x5e4918ccf433630e Time: 0.0144411 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xfac85bfa6e8a95c6 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0xfac85bfa6e8a95c6 Time: 0.0154149 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0175563 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x2640501019a61dc2 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x2640501019a61dc2 Time: 0.0154395 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.014523 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xffb9fbd2bfa6c47d [04/18/2023-18:32:30] [V] [TRT] Tactic: 0xffb9fbd2bfa6c47d Time: 0.0162027 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.0156256 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x31de506085a332d4 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x31de506085a332d4 Time: 0.0142184 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x599d6bb582ecb830 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x599d6bb582ecb830 Time: 0.0153463 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.0153152 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x601b41d38fc4645b [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x601b41d38fc4645b Time: 0.0148658 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x311b82feb19aef19 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x311b82feb19aef19 Time: 0.0140983 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xd9c6b8a2f7935fa5 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0xd9c6b8a2f7935fa5 Time: 0.0162265 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x4f35593c356e2e7e [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x4f35593c356e2e7e Time: 0.0140833 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x596666386c88024b [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x596666386c88024b Time: 0.0146313 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0171698 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0147671 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x3ffcb62b1c6bb94f Time: 0.0148151 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcddae68de84cc6ee [04/18/2023-18:32:30] [V] [TRT] Tactic: 0xcddae68de84cc6ee Time: 0.0151566 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.0161133 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdfdddae7a4bcc830 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0xdfdddae7a4bcc830 Time: 0.0168752 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xcae7b5888d47fe1f [04/18/2023-18:32:30] [V] [TRT] Tactic: 0xcae7b5888d47fe1f Time: 0.0136424 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x7247cc5dea3981f1 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x7247cc5dea3981f1 Time: 0.017086 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa5a7024b355e2bbc [04/18/2023-18:32:30] [V] [TRT] Tactic: 0xa5a7024b355e2bbc Time: 0.0142234 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.0146016 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.0164963 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x70ff342513dcddd5 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x70ff342513dcddd5 Time: 0.0165288 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.0156256 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.0147749 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3912ca79eb9a8be1 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x3912ca79eb9a8be1 Time: 0.0147941 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5947ea3454b6a27b [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x5947ea3454b6a27b Time: 0.0144 [04/18/2023-18:32:30] [V] [TRT] Fastest Tactic: 0xc22b2f91e37e472a Time: 0.0133839 [04/18/2023-18:32:30] [V] [TRT] --------------- Timing Runner: model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:30] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:30] [V] [TRT] --------------- Timing Runner: model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa71946688cad8664 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0xa71946688cad8664 Time: 0.0176163 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x1e55f8b415964e81 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x1e55f8b415964e81 Time: 0.0187903 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-18:32:30] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.0223478 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9003f5f7ff9b1aec [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x9003f5f7ff9b1aec Time: 0.0208744 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9ec201b34455146e [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x9ec201b34455146e Time: 0.0182211 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x91930a570b557437 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x91930a570b557437 Time: 0.0211487 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdf7e1bd6a496d667 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0xdf7e1bd6a496d667 Time: 0.019136 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6d377e4222886190 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x6d377e4222886190 Time: 0.0193091 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x271b998fe31732ef [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x271b998fe31732ef Time: 0.0193846 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.0193869 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x960e9baa2a6cad5b [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x960e9baa2a6cad5b Time: 0.0176996 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.0197914 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x84942841d92b0552 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x84942841d92b0552 Time: 0.0192686 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xbeb5d91e1874a437 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0xbeb5d91e1874a437 Time: 0.0188149 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcd229658c16b33cd [04/18/2023-18:32:30] [V] [TRT] Tactic: 0xcd229658c16b33cd Time: 0.0214354 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.0192571 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.0200611 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x33a5c6dd086942c1 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x33a5c6dd086942c1 Time: 0.0186509 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7720f198395e7d3d [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x7720f198395e7d3d Time: 0.0188486 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.0215876 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.0188634 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x60b880e28fee7a0c [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x60b880e28fee7a0c Time: 0.0214635 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcf64a2ae51bf6b36 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0xcf64a2ae51bf6b36 Time: 0.019784 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x844ea9c00f711f19 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x844ea9c00f711f19 Time: 0.01974 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x65fbe45b4cb1d8a5 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x65fbe45b4cb1d8a5 Time: 0.0198783 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.01874 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.0200577 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5bd8221bd57baf93 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x5bd8221bd57baf93 Time: 0.0196303 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0218181 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.0179206 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.0192166 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6e9c17a33c93d9b0 [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x6e9c17a33c93d9b0 Time: 0.0194989 [04/18/2023-18:32:30] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-18:32:30] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.0193977 [04/18/2023-18:32:30] [V] [TRT] Fastest Tactic: 0xa71946688cad8664 Time: 0.0176163 [04/18/2023-18:32:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0xc22b2f91e37e472a [04/18/2023-18:32:30] [V] [TRT] *************** Autotuning format combination: Int8(51200,6400:32,80,1) -> Half(25600,6400:32,80,1) *************** [04/18/2023-18:32:58] [V] [TRT] --------------- Timing Runner: model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) (CaskJitConv) [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xc22b2f91e37e472a [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xc22b2f91e37e472a Time: 0.0106469 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x716fcb85e712b30e [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x716fcb85e712b30e Time: 0.0116702 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x5e4918ccf433630e [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x5e4918ccf433630e Time: 0.00945886 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xfac85bfa6e8a95c6 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xfac85bfa6e8a95c6 Time: 0.0117408 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0128103 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x2640501019a61dc2 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x2640501019a61dc2 Time: 0.0110224 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.014347 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xffb9fbd2bfa6c47d [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xffb9fbd2bfa6c47d Time: 0.0116051 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.0116856 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x31de506085a332d4 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x31de506085a332d4 Time: 0.0135439 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x599d6bb582ecb830 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x599d6bb582ecb830 Time: 0.0118906 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.0149097 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x601b41d38fc4645b [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x601b41d38fc4645b Time: 0.00957105 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x311b82feb19aef19 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x311b82feb19aef19 Time: 0.0112566 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xd9c6b8a2f7935fa5 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xd9c6b8a2f7935fa5 Time: 0.012496 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x4f35593c356e2e7e [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x4f35593c356e2e7e Time: 0.00936257 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x596666386c88024b [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x596666386c88024b Time: 0.0132322 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0123074 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.00994804 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x3ffcb62b1c6bb94f Time: 0.0114222 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcddae68de84cc6ee [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xcddae68de84cc6ee Time: 0.0147995 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.0122632 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdfdddae7a4bcc830 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xdfdddae7a4bcc830 Time: 0.0120838 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xcae7b5888d47fe1f [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xcae7b5888d47fe1f Time: 0.0130747 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x7247cc5dea3981f1 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x7247cc5dea3981f1 Time: 0.0125341 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa5a7024b355e2bbc [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xa5a7024b355e2bbc Time: 0.0138232 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.0120423 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.0127554 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x70ff342513dcddd5 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x70ff342513dcddd5 Time: 0.0116315 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.0144334 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.00969173 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3912ca79eb9a8be1 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x3912ca79eb9a8be1 Time: 0.0140921 [04/18/2023-18:32:58] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5947ea3454b6a27b [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x5947ea3454b6a27b Time: 0.00970606 [04/18/2023-18:32:58] [V] [TRT] Fastest Tactic: 0x4f35593c356e2e7e Time: 0.00936257 [04/18/2023-18:32:58] [V] [TRT] --------------- Timing Runner: model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:58] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:58] [V] [TRT] --------------- Timing Runner: model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0x4f35593c356e2e7e [04/18/2023-18:32:58] [V] [TRT] =============== Computing costs for [04/18/2023-18:32:58] [V] [TRT] *************** Autotuning format combination: Float(819200,6400,80,1) -> Float(204800,1600,40,1) *************** [04/18/2023-18:32:58] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (TiledPooling) [04/18/2023-18:32:58] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-18:32:58] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (CudnnPooling) [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.00552387 [04/18/2023-18:32:58] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.00552387 [04/18/2023-18:32:58] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (CaskPooling) [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll6_tThreads256 Tactic: 0x60eceb67eff69444 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x60eceb67eff69444 Time: 0.00527902 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll3_tThreads256 Tactic: 0xee538eb5d3641457 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xee538eb5d3641457 Time: 0.00591488 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll7_tThreads128 Tactic: 0x291bf03c1842464a [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x291bf03c1842464a Time: 0.00449329 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll5_tThreads256 Tactic: 0x94ce52cf617d1e36 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x94ce52cf617d1e36 Time: 0.00530489 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll8_tThreads256 Tactic: 0xbc5c1844e5cc7959 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xbc5c1844e5cc7959 Time: 0.00515053 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll2_tThreads128 Tactic: 0xa7a495ee24d0c659 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xa7a495ee24d0c659 Time: 0.00577938 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NCHW_Max Tactic: 0xb59f9cfb90407c92 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xb59f9cfb90407c92 Time: 0.00555851 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll8_tThreads128 Tactic: 0x2802f161f2fbd8fa [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x2802f161f2fbd8fa Time: 0.00442597 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll6_tThreads128 Tactic: 0xf4b20242f8c135e7 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xf4b20242f8c135e7 Time: 0.004526 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_nd_NCDHW_kMAX_kGENERIC_3D_POOLING_MODE_kFLOAT_0 Tactic: 0x5faf4a0a8a5670ed [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x5faf4a0a8a5670ed Time: 0.00767591 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll1_tThreads128 Tactic: 0x53862c46aa5b4c2b [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x53862c46aa5b4c2b Time: 0.00846817 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll3_tThreads128 Tactic: 0x7a0d6790c453b5f4 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x7a0d6790c453b5f4 Time: 0.00497435 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll4_tThreads256 Tactic: 0x4967a0b181fe6d9b [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x4967a0b181fe6d9b Time: 0.00546235 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll2_tThreads256 Tactic: 0x33fa7ccb33e767fa [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x33fa7ccb33e767fa Time: 0.00696446 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll4_tThreads128 Tactic: 0xdd39499496c9cc38 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xdd39499496c9cc38 Time: 0.00462289 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll7_tThreads256 Tactic: 0xbd4519190f75e7e9 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xbd4519190f75e7e9 Time: 0.00530692 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll5_tThreads128 Tactic: 0x0090bbea764abf95 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x0090bbea764abf95 Time: 0.00460829 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll1_tThreads256 Tactic: 0xc7d8c563bd6ced88 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xc7d8c563bd6ced88 Time: 0.0103778 [04/18/2023-18:32:58] [V] [TRT] Fastest Tactic: 0x2802f161f2fbd8fa Time: 0.00442597 [04/18/2023-18:32:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x2802f161f2fbd8fa [04/18/2023-18:32:58] [V] [TRT] *************** Autotuning format combination: Float(204800,1:4,2560,32) -> Float(51200,1:4,1280,32) *************** [04/18/2023-18:32:58] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (CaskPooling) [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP32FP32_WINDOWSIZE_0_NOT_PROPAGATE_NAN_2D Tactic: 0xaec8628e8180bced [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xaec8628e8180bced Time: 0.00577353 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP32FP32_WINDOWSIZE_0_PROPAGATE_NAN_2D Tactic: 0x8382d5c464539e87 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x8382d5c464539e87 Time: 0.0059381 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP32FP32_WINDOWSIZE_0_NOT_PROPAGATE_NAN_3D Tactic: 0xfa211b1cdd504de0 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xfa211b1cdd504de0 Time: 0.00599048 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NHWC_Max_CAlign4 Tactic: 0x22fb1bb4a70e340d [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x22fb1bb4a70e340d Time: 0.00812622 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP32FP32_WINDOWSIZE_0_PROPAGATE_NAN_3D Tactic: 0xd76bac5638836f8a [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xd76bac5638836f8a Time: 0.0062887 [04/18/2023-18:32:58] [V] [TRT] Fastest Tactic: 0xaec8628e8180bced Time: 0.00577353 [04/18/2023-18:32:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0xaec8628e8180bced [04/18/2023-18:32:58] [V] [TRT] *************** Autotuning format combination: Half(819200,6400,80,1) -> Half(204800,1600,40,1) *************** [04/18/2023-18:32:58] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (TiledPooling) [04/18/2023-18:32:58] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-18:32:58] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (CudnnPooling) [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.00527673 [04/18/2023-18:32:58] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.00527673 [04/18/2023-18:32:58] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (CaskPooling) [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_nd_NCDHW_kMAX_kGENERIC_3D_POOLING_MODE_kHALF_0 Tactic: 0x457fb0a334d63ae2 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x457fb0a334d63ae2 Time: 0.00761047 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_fw_4d_FP16FP32NCHW_Max Tactic: 0xfd3a631f5c3e741e [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xfd3a631f5c3e741e Time: 0.0054163 [04/18/2023-18:32:58] [V] [TRT] Fastest Tactic: 0xfd3a631f5c3e741e Time: 0.0054163 [04/18/2023-18:32:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnPooling Tactic: 0xffffffffffffffff [04/18/2023-18:32:58] [V] [TRT] *************** Autotuning format combination: Half(409600,6400:2,80,1) -> Half(102400,1600:2,40,1) *************** [04/18/2023-18:32:58] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (TiledPooling) [04/18/2023-18:32:58] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-18:32:58] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (CudaPooling) [04/18/2023-18:32:58] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-18:32:58] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (CaskPooling) [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_CHWPacked_NCxHW2_kMAX Tactic: 0xc8ae100b63fd8921 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xc8ae100b63fd8921 Time: 0.00378887 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll6_tThreads256 Tactic: 0xf90e997ee69ae7fe [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xf90e997ee69ae7fe Time: 0.00471211 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll5_tThreads256 Tactic: 0x0d2c20d668116d8c [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x0d2c20d668116d8c Time: 0.00457843 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll8_tThreads128 Tactic: 0xb1e08378fb97ab40 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xb1e08378fb97ab40 Time: 0.00407632 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll2_tThreads128 Tactic: 0x3e46e7f72dbcb5e3 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x3e46e7f72dbcb5e3 Time: 0.00459043 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll8_tThreads256 Tactic: 0x25be6a5deca00ae3 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x25be6a5deca00ae3 Time: 0.00439356 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll6_tThreads128 Tactic: 0x6d50705bf1ad465d [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x6d50705bf1ad465d Time: 0.00393365 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll7_tThreads256 Tactic: 0x24a76b0006199453 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x24a76b0006199453 Time: 0.00489234 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll4_tThreads128 Tactic: 0x44db3b8d9fa5bf82 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x44db3b8d9fa5bf82 Time: 0.00393971 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll4_tThreads256 Tactic: 0xd085d2a888921e21 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xd085d2a888921e21 Time: 0.00452814 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll1_tThreads128 Tactic: 0xca645e5fa3373f91 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xca645e5fa3373f91 Time: 0.00572672 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll3_tThreads128 Tactic: 0xe3ef1589cd3fc64e [04/18/2023-18:32:58] [V] [TRT] Tactic: 0xe3ef1589cd3fc64e Time: 0.00397524 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll3_tThreads256 Tactic: 0x77b1fcacda0867ed [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x77b1fcacda0867ed Time: 0.00449571 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll1_tThreads256 Tactic: 0x5e3ab77ab4009e32 [04/18/2023-18:32:58] [V] [TRT] Tactic: 0x5e3ab77ab4009e32 Time: 0.00641888 [04/18/2023-18:32:58] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll5_tThreads128 Tactic: 0x9972c9f37f26cc2f [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x9972c9f37f26cc2f Time: 0.00389263 [04/18/2023-18:32:59] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll7_tThreads128 Tactic: 0xb0f98225112e35f0 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xb0f98225112e35f0 Time: 0.00386177 [04/18/2023-18:32:59] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll2_tThreads256 Tactic: 0xaa180ed23a8b1440 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xaa180ed23a8b1440 Time: 0.00467289 [04/18/2023-18:32:59] [V] [TRT] Fastest Tactic: 0xc8ae100b63fd8921 Time: 0.00378887 [04/18/2023-18:32:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0xc8ae100b63fd8921 [04/18/2023-18:32:59] [V] [TRT] *************** Autotuning format combination: Half(102400,1:8,1280,16) -> Half(25600,1:8,640,16) *************** [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (TiledPooling) [04/18/2023-18:32:59] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (CudaPooling) [04/18/2023-18:32:59] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (CudnnPooling) [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.00533994 [04/18/2023-18:32:59] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.00533994 [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: /model.15/m/MaxPool (CaskPooling) [04/18/2023-18:32:59] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP16FP32_WINDOWSIZE_0_PROPAGATE_NAN_3D Tactic: 0xaf2cce7cd58b3192 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xaf2cce7cd58b3192 Time: 0.00606457 [04/18/2023-18:32:59] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP16FP32_WINDOWSIZE_0_NOT_PROPAGATE_NAN_3D Tactic: 0x6cc99546c45a36fc [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x6cc99546c45a36fc Time: 0.00590391 [04/18/2023-18:32:59] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP16FP32_WINDOWSIZE_0_NOT_PROPAGATE_NAN_2D Tactic: 0x3820ecd4988ac7f1 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x3820ecd4988ac7f1 Time: 0.00547115 [04/18/2023-18:32:59] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP16FP32_WINDOWSIZE_0_PROPAGATE_NAN_2D Tactic: 0xfbc5b7ee895bc09f [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xfbc5b7ee895bc09f Time: 0.00563657 [04/18/2023-18:32:59] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_coalescedC_NHWC_kMAX_3_False Tactic: 0xdb415cba6b0e9137 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xdb415cba6b0e9137 Time: 0.00327647 [04/18/2023-18:32:59] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_coalescedC_NHWC_kMAX_2_False Tactic: 0xf9ae51e35ff7f5db [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xf9ae51e35ff7f5db Time: 0.00325174 [04/18/2023-18:32:59] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_fw_4d_FP16FP32NHWC_Max_CAlign8 Tactic: 0x6613a704fbea2e33 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x6613a704fbea2e33 Time: 0.00527233 [04/18/2023-18:32:59] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_fw_4d_FP16FP32NHWC_Max_CAlign4 Tactic: 0xea62e389fb7bcc66 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xea62e389fb7bcc66 Time: 0.00781426 [04/18/2023-18:32:59] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_nd_NDHWC_kMAX_kGENERIC_3D_POOLING_MODE_kHALF_3 Tactic: 0x173cb53487e766c4 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x173cb53487e766c4 Time: 0.00876424 [04/18/2023-18:32:59] [V] [TRT] Fastest Tactic: 0xf9ae51e35ff7f5db Time: 0.00325174 [04/18/2023-18:32:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0xf9ae51e35ff7f5db [04/18/2023-18:32:59] [V] [TRT] =============== Computing costs for [04/18/2023-18:32:59] [V] [TRT] *************** Autotuning format combination: Int8(819200,6400,80,1) -> Int8(819200,6400,80,1) long-strided *************** [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] *************** Autotuning format combination: Int8(819200,6400,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400:4,80,1) -> Int8(204800,6400:4,80,1) long-strided *************** [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:32:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400:4,80,1) -> Int8(25600,6400:32,80,1) long-strided *************** [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400:4,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:32:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] *************** Autotuning format combination: Int8(25600,6400:32,80,1) -> Int8(25600,6400:32,80,1) long-strided *************** [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:32:59] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:32:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00787248 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00788692 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00810133 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00702389 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00734491 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00767134 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00597124 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00618038 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00756908 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00820749 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00567051 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00632885 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0116301 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00590885 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00619238 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00821206 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.0066774 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.00875052 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00852733 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00915229 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0117482 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00579749 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00714606 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00726537 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00636482 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.012093 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00628492 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00795886 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00880081 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0108869 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00774857 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00783567 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00592256 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.007328 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0107099 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0118098 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0095741 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00579712 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00596229 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00769035 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0106838 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0103073 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00894914 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00852383 [04/18/2023-18:32:59] [V] [TRT] Fastest Tactic: 0x25bf7139bbd93bc8 Time: 0.00567051 [04/18/2023-18:32:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:32:59] [V] [TRT] *************** Autotuning format combination: Int8(25600,6400:32,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:32:59] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:32:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.0074672 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00782364 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00805384 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.0070794 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00743657 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00773101 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00600286 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00617543 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00759146 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00812368 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00569952 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00599562 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0115977 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00586258 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00617047 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00822705 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00666452 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.00875106 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00854696 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00893943 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0117774 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00574427 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00714057 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00729623 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00637078 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0118927 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00629028 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00798654 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00887341 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0108842 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00775218 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00782099 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.0058677 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00735657 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0106847 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0117816 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00957166 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00578633 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00598743 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00769636 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0106798 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0102727 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00894057 [04/18/2023-18:32:59] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00851012 [04/18/2023-18:32:59] [V] [TRT] Fastest Tactic: 0x25bf7139bbd93bc8 Time: 0.00569952 [04/18/2023-18:32:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:32:59] [V] [TRT] =============== Computing costs for [04/18/2023-18:32:59] [V] [TRT] *************** Autotuning format combination: Int8(204800,1600,40,1) -> Int8(819200,1600,40,1) long-strided *************** [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] *************** Autotuning format combination: Int8(204800,1600,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(204800,1600:4,40,1) long-strided *************** [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:32:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(25600,1600:32,40,1) long-strided *************** [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:32:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Int8(25600,1600:32,40,1) long-strided *************** [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:32:59] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:32:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00536245 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00538209 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00550857 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00492587 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00518367 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00534637 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00473172 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00491566 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00540512 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00545913 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00523543 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00553688 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.00983406 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00543272 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00581687 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00808762 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00480198 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.00812521 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00786093 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00821003 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0101214 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00464251 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00504922 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0049466 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00601676 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0102514 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00576768 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00520261 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00864027 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0109224 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00528457 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00582327 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00536855 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.0052031 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0107736 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0102854 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00877956 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00532283 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.0046083 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00504402 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0108898 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.01043 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:32:59] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00873546 [04/18/2023-18:32:59] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-18:32:59] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.0084964 [04/18/2023-18:32:59] [V] [TRT] Fastest Tactic: 0xace5d20e37ef6496 Time: 0.0046083 [04/18/2023-18:32:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xace5d20e37ef6496 [04/18/2023-18:32:59] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:32:59] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:32:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:32:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:32:59] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:32:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00526792 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00544237 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00538565 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00511265 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00529608 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00534671 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00476404 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00492053 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.0052049 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00543932 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00516947 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00553072 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.00985905 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.0055353 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00581321 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00812216 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00479543 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.008112 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00793119 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00822121 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.01013 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00474264 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00510808 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00497119 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00603181 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0102727 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00573897 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00520604 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00860773 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0109996 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00539259 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00582638 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00536483 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00512163 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0107882 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0103089 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00872202 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00525633 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00461803 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00508674 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0107383 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0104251 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00873439 [04/18/2023-18:33:00] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00845042 [04/18/2023-18:33:00] [V] [TRT] Fastest Tactic: 0xace5d20e37ef6496 Time: 0.00461803 [04/18/2023-18:33:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:00] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:00] [V] [TRT] *************** Autotuning format combination: Int8(204800,1600,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear + /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear + /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear + /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear + /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear + /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear + /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear + /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear + /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:33:00] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:00] [V] [TRT] *************** Autotuning format combination: Int8(204800,1600,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:33:00] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.00964815 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00987429 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00805689 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.00937914 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00976518 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.00785588 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.0082494 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.0100535 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0103615 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0104454 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0173394 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.0100166 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.0102736 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0176396 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0291109 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00937857 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0112387 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0287369 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0289353 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0128278 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0113101 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.020224 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0295845 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.0076634 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0130336 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0299227 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0295643 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0193097 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0117155 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00859375 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00975421 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.018196 [04/18/2023-18:33:00] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0175858 [04/18/2023-18:33:00] [V] [TRT] Fastest Tactic: 0x5e921a04a7b0e583 Time: 0.0076634 [04/18/2023-18:33:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:33:00] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:00] [V] [TRT] *************** Autotuning format combination: Int8(204800,1600,40,1) -> Int8(819200,1600,40,1) long-strided *************** [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] *************** Autotuning format combination: Int8(204800,1600,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(204800,1600:4,40,1) long-strided *************** [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(25600,1600:32,40,1) long-strided *************** [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Int8(25600,1600:32,40,1) long-strided *************** [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:33:00] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.0096579 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00985722 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00809219 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.00942343 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.0097277 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.00783206 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00815086 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.010077 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0103687 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0104287 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0173557 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.0100928 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.0103125 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0176985 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0290816 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00947857 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0112605 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0287342 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0289353 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0128244 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0112109 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.020224 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0295433 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.0077849 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0130481 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0298798 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0295808 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0193189 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0115745 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00860719 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00976305 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.018224 [04/18/2023-18:33:00] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0176173 [04/18/2023-18:33:00] [V] [TRT] Fastest Tactic: 0x5e921a04a7b0e583 Time: 0.0077849 [04/18/2023-18:33:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:33:00] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:33:00] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:00] [V] [TRT] *************** Autotuning format combination: Int8(204800,1600:4,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 0xc25454de2efcccdc [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xc25454de2efcccdc Time: 0.0219148 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: 0xff6944b17d5b2e32 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xff6944b17d5b2e32 Time: 0.0214315 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.0306551 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.0228937 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.0265265 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0235729 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.0304859 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0221492 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 0x1db6e8cf1382fbe0 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x1db6e8cf1382fbe0 Time: 0.0302153 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: 0xa4ae2d82115c3e83 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xa4ae2d82115c3e83 Time: 0.0250499 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.0223804 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.0273029 [04/18/2023-18:33:00] [V] [TRT] Fastest Tactic: 0xff6944b17d5b2e32 Time: 0.0214315 [04/18/2023-18:33:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xff6944b17d5b2e32 [04/18/2023-18:33:00] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:32,40,1) -> Float(409600,1600,40,1) *************** [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x733ba2a91a48d431 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x733ba2a91a48d431 Time: 0.0138174 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0xf04572b287451f42 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xf04572b287451f42 Time: 0.0144594 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x5e4f6d7c83746fd6 Time: 0.016802 [04/18/2023-18:33:00] [V] [TRT] Fastest Tactic: 0x733ba2a91a48d431 Time: 0.0138174 [04/18/2023-18:33:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x733ba2a91a48d431 [04/18/2023-18:33:00] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:32,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (CaskJitConv) [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xc22b2f91e37e472a [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xc22b2f91e37e472a Time: 0.0105659 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x716fcb85e712b30e [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x716fcb85e712b30e Time: 0.0205571 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x5e4918ccf433630e [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x5e4918ccf433630e Time: 0.0123223 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xfac85bfa6e8a95c6 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xfac85bfa6e8a95c6 Time: 0.010162 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0216797 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x2640501019a61dc2 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x2640501019a61dc2 Time: 0.0100157 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.0117915 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xffb9fbd2bfa6c47d [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xffb9fbd2bfa6c47d Time: 0.0112988 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.0106916 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x31de506085a332d4 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x31de506085a332d4 Time: 0.0123642 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x599d6bb582ecb830 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x599d6bb582ecb830 Time: 0.00991055 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.0130606 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x601b41d38fc4645b [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x601b41d38fc4645b Time: 0.012699 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x311b82feb19aef19 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x311b82feb19aef19 Time: 0.0109936 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xd9c6b8a2f7935fa5 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xd9c6b8a2f7935fa5 Time: 0.0113375 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x4f35593c356e2e7e [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x4f35593c356e2e7e Time: 0.012525 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x596666386c88024b [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x596666386c88024b Time: 0.0125764 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0211239 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0133664 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x3ffcb62b1c6bb94f Time: 0.00970148 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcddae68de84cc6ee [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xcddae68de84cc6ee Time: 0.0135007 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.0105593 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdfdddae7a4bcc830 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xdfdddae7a4bcc830 Time: 0.0210651 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xcae7b5888d47fe1f [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xcae7b5888d47fe1f Time: 0.0118396 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x7247cc5dea3981f1 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x7247cc5dea3981f1 Time: 0.0210697 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa5a7024b355e2bbc [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xa5a7024b355e2bbc Time: 0.0123783 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.0111251 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.0116702 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x70ff342513dcddd5 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x70ff342513dcddd5 Time: 0.0206282 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.0123611 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.0126537 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3912ca79eb9a8be1 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x3912ca79eb9a8be1 Time: 0.0134034 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5947ea3454b6a27b [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x5947ea3454b6a27b Time: 0.012968 [04/18/2023-18:33:00] [V] [TRT] Fastest Tactic: 0x3ffcb62b1c6bb94f Time: 0.00970148 [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa71946688cad8664 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xa71946688cad8664 Time: 0.0139449 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x1e55f8b415964e81 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x1e55f8b415964e81 Time: 0.0159939 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.0156087 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9003f5f7ff9b1aec [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x9003f5f7ff9b1aec Time: 0.0241455 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9ec201b34455146e [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x9ec201b34455146e Time: 0.0150734 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x91930a570b557437 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x91930a570b557437 Time: 0.0240168 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdf7e1bd6a496d667 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xdf7e1bd6a496d667 Time: 0.016126 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6d377e4222886190 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x6d377e4222886190 Time: 0.0166248 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x271b998fe31732ef [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x271b998fe31732ef Time: 0.0134151 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.0153605 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x960e9baa2a6cad5b [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x960e9baa2a6cad5b Time: 0.0138759 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.0157166 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x84942841d92b0552 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x84942841d92b0552 Time: 0.0162885 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xbeb5d91e1874a437 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xbeb5d91e1874a437 Time: 0.0157362 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcd229658c16b33cd [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xcd229658c16b33cd Time: 0.0244693 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.0134708 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.0138045 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x33a5c6dd086942c1 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x33a5c6dd086942c1 Time: 0.0153454 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7720f198395e7d3d [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x7720f198395e7d3d Time: 0.0130078 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.0243642 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.0161539 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x60b880e28fee7a0c [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x60b880e28fee7a0c Time: 0.0242865 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcf64a2ae51bf6b36 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xcf64a2ae51bf6b36 Time: 0.0159782 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x844ea9c00f711f19 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x844ea9c00f711f19 Time: 0.0136008 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x65fbe45b4cb1d8a5 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x65fbe45b4cb1d8a5 Time: 0.0158791 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.0149536 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.0162723 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5bd8221bd57baf93 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x5bd8221bd57baf93 Time: 0.0166395 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0249486 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.0139865 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.0165714 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6e9c17a33c93d9b0 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x6e9c17a33c93d9b0 Time: 0.0134329 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.0173211 [04/18/2023-18:33:00] [V] [TRT] Fastest Tactic: 0x7720f198395e7d3d Time: 0.0130078 [04/18/2023-18:33:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-18:33:00] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:32,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:33:00] [V] [TRT] --------------- Timing Runner: model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (CaskJitConv) [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xc22b2f91e37e472a [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xc22b2f91e37e472a Time: 0.00848833 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x716fcb85e712b30e [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x716fcb85e712b30e Time: 0.0162377 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x5e4918ccf433630e [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x5e4918ccf433630e Time: 0.0102782 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xfac85bfa6e8a95c6 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xfac85bfa6e8a95c6 Time: 0.00822324 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0173333 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x2640501019a61dc2 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x2640501019a61dc2 Time: 0.00782605 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-18:33:00] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00998857 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xffb9fbd2bfa6c47d [04/18/2023-18:33:00] [V] [TRT] Tactic: 0xffb9fbd2bfa6c47d Time: 0.00787729 [04/18/2023-18:33:00] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.00741188 [04/18/2023-18:33:01] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x31de506085a332d4 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x31de506085a332d4 Time: 0.0101263 [04/18/2023-18:33:01] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x599d6bb582ecb830 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x599d6bb582ecb830 Time: 0.00718606 [04/18/2023-18:33:01] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.0112879 [04/18/2023-18:33:01] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x601b41d38fc4645b [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x601b41d38fc4645b Time: 0.00938 [04/18/2023-18:33:01] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x311b82feb19aef19 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x311b82feb19aef19 Time: 0.00784505 [04/18/2023-18:33:01] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xd9c6b8a2f7935fa5 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xd9c6b8a2f7935fa5 Time: 0.00828445 [04/18/2023-18:33:01] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x4f35593c356e2e7e [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x4f35593c356e2e7e Time: 0.00925543 [04/18/2023-18:33:01] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x596666386c88024b [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x596666386c88024b Time: 0.0103197 [04/18/2023-18:33:01] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0149083 [04/18/2023-18:33:01] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0099392 [04/18/2023-18:33:01] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x3ffcb62b1c6bb94f Time: 0.00700561 [04/18/2023-18:33:01] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcddae68de84cc6ee [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xcddae68de84cc6ee Time: 0.0117591 [04/18/2023-18:33:01] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00728229 [04/18/2023-18:33:01] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdfdddae7a4bcc830 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xdfdddae7a4bcc830 Time: 0.0147749 [04/18/2023-18:33:01] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xcae7b5888d47fe1f [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xcae7b5888d47fe1f Time: 0.0101385 [04/18/2023-18:33:01] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x7247cc5dea3981f1 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x7247cc5dea3981f1 Time: 0.0148128 [04/18/2023-18:33:01] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa5a7024b355e2bbc [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xa5a7024b355e2bbc Time: 0.0106136 [04/18/2023-18:33:01] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00823924 [04/18/2023-18:33:01] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.00849667 [04/18/2023-18:33:01] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x70ff342513dcddd5 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x70ff342513dcddd5 Time: 0.0143067 [04/18/2023-18:33:01] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.0102433 [04/18/2023-18:33:01] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.00944372 [04/18/2023-18:33:01] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3912ca79eb9a8be1 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x3912ca79eb9a8be1 Time: 0.0113554 [04/18/2023-18:33:01] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5947ea3454b6a27b [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x5947ea3454b6a27b Time: 0.0095811 [04/18/2023-18:33:01] [V] [TRT] Fastest Tactic: 0x3ffcb62b1c6bb94f Time: 0.00700561 [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-18:33:01] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:01] [V] [TRT] *************** Autotuning format combination: Float(409600,1600,40,1) -> Float(102400,400,20,1) *************** [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (TiledPooling) [04/18/2023-18:33:01] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (CudnnPooling) [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.00482133 [04/18/2023-18:33:01] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.00482133 [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (CaskPooling) [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll6_tThreads256 Tactic: 0x60eceb67eff69444 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x60eceb67eff69444 Time: 0.0034129 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll3_tThreads256 Tactic: 0xee538eb5d3641457 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xee538eb5d3641457 Time: 0.00362914 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll7_tThreads128 Tactic: 0x291bf03c1842464a [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x291bf03c1842464a Time: 0.00333725 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll5_tThreads256 Tactic: 0x94ce52cf617d1e36 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x94ce52cf617d1e36 Time: 0.00343576 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll8_tThreads256 Tactic: 0xbc5c1844e5cc7959 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xbc5c1844e5cc7959 Time: 0.00324841 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll2_tThreads128 Tactic: 0xa7a495ee24d0c659 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xa7a495ee24d0c659 Time: 0.00407009 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NCHW_Max Tactic: 0xb59f9cfb90407c92 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xb59f9cfb90407c92 Time: 0.00369266 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll8_tThreads128 Tactic: 0x2802f161f2fbd8fa [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x2802f161f2fbd8fa Time: 0.00329371 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll6_tThreads128 Tactic: 0xf4b20242f8c135e7 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xf4b20242f8c135e7 Time: 0.00334108 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_nd_NCDHW_kMAX_kGENERIC_3D_POOLING_MODE_kFLOAT_0 Tactic: 0x5faf4a0a8a5670ed [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x5faf4a0a8a5670ed Time: 0.00463956 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll1_tThreads128 Tactic: 0x53862c46aa5b4c2b [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x53862c46aa5b4c2b Time: 0.00567736 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll3_tThreads128 Tactic: 0x7a0d6790c453b5f4 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x7a0d6790c453b5f4 Time: 0.00363303 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll4_tThreads256 Tactic: 0x4967a0b181fe6d9b [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x4967a0b181fe6d9b Time: 0.00352703 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll2_tThreads256 Tactic: 0x33fa7ccb33e767fa [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x33fa7ccb33e767fa Time: 0.00405181 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll4_tThreads128 Tactic: 0xdd39499496c9cc38 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xdd39499496c9cc38 Time: 0.00349514 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll7_tThreads256 Tactic: 0xbd4519190f75e7e9 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xbd4519190f75e7e9 Time: 0.00331886 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll5_tThreads128 Tactic: 0x0090bbea764abf95 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x0090bbea764abf95 Time: 0.00339189 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP32NCHW_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll1_tThreads256 Tactic: 0xc7d8c563bd6ced88 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xc7d8c563bd6ced88 Time: 0.00570462 [04/18/2023-18:33:01] [V] [TRT] Fastest Tactic: 0xbc5c1844e5cc7959 Time: 0.00324841 [04/18/2023-18:33:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0xbc5c1844e5cc7959 [04/18/2023-18:33:01] [V] [TRT] *************** Autotuning format combination: Float(102400,1:4,2560,64) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (CaskPooling) [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP32FP32_WINDOWSIZE_0_NOT_PROPAGATE_NAN_2D Tactic: 0xaec8628e8180bced [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xaec8628e8180bced Time: 0.00388263 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP32FP32_WINDOWSIZE_0_PROPAGATE_NAN_2D Tactic: 0x8382d5c464539e87 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x8382d5c464539e87 Time: 0.00398146 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP32FP32_WINDOWSIZE_0_NOT_PROPAGATE_NAN_3D Tactic: 0xfa211b1cdd504de0 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xfa211b1cdd504de0 Time: 0.00404533 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NHWC_Max_CAlign4 Tactic: 0x22fb1bb4a70e340d [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x22fb1bb4a70e340d Time: 0.00460329 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP32FP32_WINDOWSIZE_0_PROPAGATE_NAN_3D Tactic: 0xd76bac5638836f8a [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xd76bac5638836f8a Time: 0.00426568 [04/18/2023-18:33:01] [V] [TRT] Fastest Tactic: 0xaec8628e8180bced Time: 0.00388263 [04/18/2023-18:33:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0xaec8628e8180bced [04/18/2023-18:33:01] [V] [TRT] *************** Autotuning format combination: Half(409600,1600,40,1) -> Half(102400,400,20,1) *************** [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (TiledPooling) [04/18/2023-18:33:01] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (CudnnPooling) [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.00340833 [04/18/2023-18:33:01] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.00340833 [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (CaskPooling) [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_nd_NCDHW_kMAX_kGENERIC_3D_POOLING_MODE_kHALF_0 Tactic: 0x457fb0a334d63ae2 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x457fb0a334d63ae2 Time: 0.00462938 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_fw_4d_FP16FP32NCHW_Max Tactic: 0xfd3a631f5c3e741e [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xfd3a631f5c3e741e Time: 0.00347657 [04/18/2023-18:33:01] [V] [TRT] Fastest Tactic: 0xfd3a631f5c3e741e Time: 0.00347657 [04/18/2023-18:33:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnPooling Tactic: 0xffffffffffffffff [04/18/2023-18:33:01] [V] [TRT] *************** Autotuning format combination: Half(204800,1600:2,40,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (TiledPooling) [04/18/2023-18:33:01] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (CudaPooling) [04/18/2023-18:33:01] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (CaskPooling) [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_CHWPacked_NCxHW2_kMAX Tactic: 0xc8ae100b63fd8921 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xc8ae100b63fd8921 Time: 0.00275095 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll6_tThreads256 Tactic: 0xf90e997ee69ae7fe [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xf90e997ee69ae7fe Time: 0.00322479 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll5_tThreads256 Tactic: 0x0d2c20d668116d8c [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x0d2c20d668116d8c Time: 0.00321818 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll8_tThreads128 Tactic: 0xb1e08378fb97ab40 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xb1e08378fb97ab40 Time: 0.00314355 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll2_tThreads128 Tactic: 0x3e46e7f72dbcb5e3 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x3e46e7f72dbcb5e3 Time: 0.00331366 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll8_tThreads256 Tactic: 0x25be6a5deca00ae3 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x25be6a5deca00ae3 Time: 0.00328436 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll6_tThreads128 Tactic: 0x6d50705bf1ad465d [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x6d50705bf1ad465d Time: 0.00314792 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll7_tThreads256 Tactic: 0x24a76b0006199453 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x24a76b0006199453 Time: 0.00314474 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll4_tThreads128 Tactic: 0x44db3b8d9fa5bf82 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x44db3b8d9fa5bf82 Time: 0.00297133 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll4_tThreads256 Tactic: 0xd085d2a888921e21 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xd085d2a888921e21 Time: 0.00299857 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll1_tThreads128 Tactic: 0xca645e5fa3373f91 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xca645e5fa3373f91 Time: 0.00405562 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll3_tThreads128 Tactic: 0xe3ef1589cd3fc64e [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xe3ef1589cd3fc64e Time: 0.00318212 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll3_tThreads256 Tactic: 0x77b1fcacda0867ed [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x77b1fcacda0867ed Time: 0.00332672 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll1_tThreads256 Tactic: 0x5e3ab77ab4009e32 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x5e3ab77ab4009e32 Time: 0.00404178 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll5_tThreads128 Tactic: 0x9972c9f37f26cc2f [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x9972c9f37f26cc2f Time: 0.00315747 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ16_tR2_tS2_tU2_tV2_tUnroll7_tThreads128 Tactic: 0xb0f98225112e35f0 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xb0f98225112e35f0 Time: 0.00317307 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_tiled_FP16NCxHW2_kMAX_tP2_tQ32_tR2_tS2_tU2_tV2_tUnroll2_tThreads256 Tactic: 0xaa180ed23a8b1440 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xaa180ed23a8b1440 Time: 0.00325995 [04/18/2023-18:33:01] [V] [TRT] Fastest Tactic: 0xc8ae100b63fd8921 Time: 0.00275095 [04/18/2023-18:33:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0xc8ae100b63fd8921 [04/18/2023-18:33:01] [V] [TRT] *************** Autotuning format combination: Half(51200,1:8,1280,32) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (TiledPooling) [04/18/2023-18:33:01] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (CudaPooling) [04/18/2023-18:33:01] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (CudnnPooling) [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xffffffffffffffff Time: 0.00486751 [04/18/2023-18:33:01] [V] [TRT] Fastest Tactic: 0xffffffffffffffff Time: 0.00486751 [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: /model.22/m/MaxPool (CaskPooling) [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP16FP32_WINDOWSIZE_0_PROPAGATE_NAN_3D Tactic: 0xaf2cce7cd58b3192 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xaf2cce7cd58b3192 Time: 0.00417476 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP16FP32_WINDOWSIZE_0_NOT_PROPAGATE_NAN_3D Tactic: 0x6cc99546c45a36fc [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x6cc99546c45a36fc Time: 0.00405701 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP16FP32_WINDOWSIZE_0_NOT_PROPAGATE_NAN_2D Tactic: 0x3820ecd4988ac7f1 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x3820ecd4988ac7f1 Time: 0.00390771 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_max_nhwc_FP16FP32_WINDOWSIZE_0_PROPAGATE_NAN_2D Tactic: 0xfbc5b7ee895bc09f [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xfbc5b7ee895bc09f Time: 0.00402006 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_coalescedC_NHWC_kMAX_3_False Tactic: 0xdb415cba6b0e9137 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xdb415cba6b0e9137 Time: 0.00283922 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_coalescedC_NHWC_kMAX_2_False Tactic: 0xf9ae51e35ff7f5db [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xf9ae51e35ff7f5db Time: 0.00273725 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_fw_4d_FP16FP32NHWC_Max_CAlign8 Tactic: 0x6613a704fbea2e33 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x6613a704fbea2e33 Time: 0.00376626 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_fw_4d_FP16FP32NHWC_Max_CAlign4 Tactic: 0xea62e389fb7bcc66 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xea62e389fb7bcc66 Time: 0.00491337 [04/18/2023-18:33:01] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_nd_NDHWC_kMAX_kGENERIC_3D_POOLING_MODE_kHALF_3 Tactic: 0x173cb53487e766c4 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x173cb53487e766c4 Time: 0.00537329 [04/18/2023-18:33:01] [V] [TRT] Fastest Tactic: 0xf9ae51e35ff7f5db Time: 0.00273725 [04/18/2023-18:33:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0xf9ae51e35ff7f5db [04/18/2023-18:33:01] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:01] [V] [TRT] *************** Autotuning format combination: Int8(409600,1600,40,1) -> Int8(409600,1600,40,1) long-strided *************** [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] *************** Autotuning format combination: Int8(409600,1600,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(102400,1600:4,40,1) long-strided *************** [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(12800,1600:32,40,1) long-strided *************** [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Int8(12800,1600:32,40,1) long-strided *************** [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:33:01] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00579675 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00589678 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00585216 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00531911 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00571867 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00568123 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00509178 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00562743 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00585143 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0059328 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00554444 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00601124 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0112844 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00597524 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00656769 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00866689 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00530404 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.0088554 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00876424 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00876477 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0115485 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00490286 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00552809 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00535382 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00651574 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0119284 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00653527 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00561301 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00966491 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0128328 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00581925 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00657808 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.0057483 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00562497 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0122491 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0119459 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00943314 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00580681 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00489661 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00541359 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0121783 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0117317 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00933172 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00890649 [04/18/2023-18:33:01] [V] [TRT] Fastest Tactic: 0xace5d20e37ef6496 Time: 0.00489661 [04/18/2023-18:33:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:01] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:33:01] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00584265 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.0058496 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00580608 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00535602 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00587355 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00588672 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00506987 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00525535 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00564484 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00616648 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00552211 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00585271 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.011296 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.0059253 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00636204 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00867711 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00523053 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.00888713 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00861284 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00895914 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0115597 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00489341 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00552106 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00534146 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00657829 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0119101 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00658888 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00562339 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00959665 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0126415 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00573934 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0065201 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00575598 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.0056211 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0122358 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0119486 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00939429 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00582363 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00485821 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0053335 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.012173 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0117465 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:33:01] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00936486 [04/18/2023-18:33:01] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-18:33:01] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00890702 [04/18/2023-18:33:01] [V] [TRT] Fastest Tactic: 0xace5d20e37ef6496 Time: 0.00485821 [04/18/2023-18:33:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:01] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,400,20,1) -> Int8(409600,400,20,1) long-strided *************** [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] *************** Autotuning format combination: Int8(102400,400,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(102400,400:4,20,1) long-strided *************** [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(12800,400:32,20,1) long-strided *************** [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(12800,400:32,20,1) long-strided *************** [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:33:01] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:01] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:01] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00448143 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00444772 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0046223 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00450143 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00471034 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00442431 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00453243 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00458357 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00519363 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00549587 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00533587 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00562848 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0117721 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00562514 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.0059901 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00862198 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00438414 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.00868007 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00843375 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00872632 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.012064 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00429795 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00436835 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00495007 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00624517 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0122804 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00632109 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0055687 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00992396 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0126415 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00533723 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00453557 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00560387 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00433801 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0121737 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0121375 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00943543 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00573001 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00476078 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00460443 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0121646 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0117405 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00931486 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00895171 [04/18/2023-18:33:02] [V] [TRT] Fastest Tactic: 0x0779fa4ac8f9f2ee Time: 0.00429795 [04/18/2023-18:33:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:33:02] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:33:02] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00428302 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00443248 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00461228 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00448929 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00471093 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00441364 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00440409 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.004582 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00520408 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00546929 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00534146 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00563569 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0117869 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00566506 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.005972 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.008512 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00437112 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.0086357 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00841976 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00876397 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0120484 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.0042923 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00426877 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00492282 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00626047 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0121775 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00631255 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00557732 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00959482 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0126655 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.0053672 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00452729 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00549215 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00429526 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0121768 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.012096 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00940943 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00577701 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00506089 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00456714 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0121425 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0117152 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00932457 [04/18/2023-18:33:02] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00883926 [04/18/2023-18:33:02] [V] [TRT] Fastest Tactic: 0x4862d9a1cd4ec818 Time: 0.00426877 [04/18/2023-18:33:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:33:02] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:02] [V] [TRT] *************** Autotuning format combination: Int8(102400,400,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear + /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear + /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear + /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear + /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear + /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear + /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear + /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear + /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:33:02] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:02] [V] [TRT] *************** Autotuning format combination: Int8(102400,400,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:33:02] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.00843348 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00865345 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00989562 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.00811886 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00837613 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.0101367 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.0104983 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.0139882 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0142558 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0145001 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0258027 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.0141623 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.0145079 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.026112 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.046384 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0127349 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0158153 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0461794 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0462994 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0188234 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0160584 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0303982 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0468023 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.00917657 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0102429 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0476891 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0478354 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0285958 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0164815 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.011532 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0105176 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0266728 [04/18/2023-18:33:02] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-18:33:02] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0260472 [04/18/2023-18:33:02] [V] [TRT] Fastest Tactic: 0x83caf00de690c0ec Time: 0.00811886 [04/18/2023-18:33:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x83caf00de690c0ec [04/18/2023-18:33:02] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:02] [V] [TRT] *************** Autotuning format combination: Int8(102400,400,20,1) -> Int8(409600,400,20,1) long-strided *************** [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] *************** Autotuning format combination: Int8(102400,400,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(102400,400:4,20,1) long-strided *************** [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(12800,400:32,20,1) long-strided *************** [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(12800,400:32,20,1) long-strided *************** [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:33:02] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:02] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:02] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.00966735 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0099584 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0112292 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.00931657 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00953417 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.0115186 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.0119284 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.0157573 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0159253 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0163535 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0291694 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.0159939 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.0163652 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0295424 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0525074 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0144576 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0178743 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0522575 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0523703 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0212741 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0181029 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0343579 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0529158 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.0103967 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0115661 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0540114 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0538133 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0321829 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0186697 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.0130286 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0119227 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0302181 [04/18/2023-18:33:03] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0294619 [04/18/2023-18:33:03] [V] [TRT] Fastest Tactic: 0x83caf00de690c0ec Time: 0.00931657 [04/18/2023-18:33:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x83caf00de690c0ec [04/18/2023-18:33:03] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:33:03] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:03] [V] [TRT] *************** Autotuning format combination: Int8(409600,400,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] *************** Autotuning format combination: Int8(102400,400:4,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:03] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] *************** Autotuning format combination: Int8(102400,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] *************** Autotuning format combination: Int8(12800,400:32,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:33:03] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:03] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.0112911 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.0116571 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0110273 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00988739 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0102942 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.0103758 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00807467 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00835683 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00971276 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0101239 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00990263 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.010366 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0278918 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.0108457 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.0113048 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.0169448 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00991665 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.0171185 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.0169854 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.017248 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0281227 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00818108 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00982522 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0102201 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0113357 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0282065 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0123825 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0105789 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0193514 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0288439 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00987855 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0137575 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00986697 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.0100687 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.028509 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0282583 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0184469 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0108709 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00832026 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00970788 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.028339 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0280465 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0178971 [04/18/2023-18:33:03] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.0172825 [04/18/2023-18:33:03] [V] [TRT] Fastest Tactic: 0x4df7e35b8de312d7 Time: 0.00807467 [04/18/2023-18:33:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:33:03] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:03] [V] [TRT] *************** Autotuning format combination: Int8(204800,400,20,1) -> Int8(204800,400,20,1) long-strided *************** [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] *************** Autotuning format combination: Int8(204800,400,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(51200,400:4,20,1) long-strided *************** [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:03] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(6400,400:32,20,1) long-strided *************** [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:03] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Int8(6400,400:32,20,1) long-strided *************** [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:33:03] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:03] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.005856 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00595867 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00617543 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00582144 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.006076 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00574446 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.0058635 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00604724 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00719086 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00745806 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00727291 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00783182 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0180874 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00784313 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00814502 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.0118913 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00563306 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.0121421 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.0118836 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0122392 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0184143 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00571007 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00551156 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00667449 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00831137 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0184594 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00879946 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00779838 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0136682 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.019 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00727566 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00598724 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.0074288 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.005552 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.018528 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0184897 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0131956 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00798578 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00638668 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00605029 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.018324 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0179749 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:33:03] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0129899 [04/18/2023-18:33:03] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-18:33:03] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.0121787 [04/18/2023-18:33:03] [V] [TRT] Fastest Tactic: 0x4862d9a1cd4ec818 Time: 0.00551156 [04/18/2023-18:33:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:33:03] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:33:03] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:03] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:03] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00581248 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00597676 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00610571 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00572471 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00605372 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00572288 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.0058869 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00607352 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00716686 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00747566 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00726263 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00783423 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0180874 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00782797 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00808965 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.0118351 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.0055949 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.0121429 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.0118604 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.012227 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.018432 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00569881 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00553793 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00670026 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00832559 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.018452 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00882608 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00783543 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.013706 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0189491 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00729234 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00596876 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00742766 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00556448 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0184931 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0185109 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0132197 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00795403 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00637734 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00603943 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0182617 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0179234 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0129219 [04/18/2023-18:33:04] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.0121829 [04/18/2023-18:33:04] [V] [TRT] Fastest Tactic: 0x4862d9a1cd4ec818 Time: 0.00553793 [04/18/2023-18:33:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:33:04] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:04] [V] [TRT] *************** Autotuning format combination: Int8(204800,400,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear + /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:04] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear + /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear + /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:04] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear + /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:04] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear + /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:04] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear + /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear + /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:04] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear + /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:33:04] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:04] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(102400,400:4,20,1) long-strided *************** [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool (TiledPooling) [04/18/2023-18:33:04] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool (CudaPooling) [04/18/2023-18:33:04] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool (CaskPooling) [04/18/2023-18:33:04] [V] [TRT] /model.31/m/MaxPool Set Tactic Name: sm50_xmma_pooling_CHWPacked_NCxHW4_kMAX Tactic: 0x1f6c40e3e09ec730 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x1f6c40e3e09ec730 Time: 0.00547708 [04/18/2023-18:33:04] [V] [TRT] Fastest Tactic: 0x1f6c40e3e09ec730 Time: 0.00547708 [04/18/2023-18:33:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x1f6c40e3e09ec730 [04/18/2023-18:33:04] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool (TiledPooling) [04/18/2023-18:33:04] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool (CudaPooling) [04/18/2023-18:33:04] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool (CaskPooling) [04/18/2023-18:33:04] [V] [TRT] /model.31/m/MaxPool Set Tactic Name: sm50_xmma_pooling_CHWPacked_NCxHW4_kMAX Tactic: 0x1f6c40e3e09ec730 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x1f6c40e3e09ec730 Time: 0.00549714 [04/18/2023-18:33:04] [V] [TRT] Fastest Tactic: 0x1f6c40e3e09ec730 Time: 0.00549714 [04/18/2023-18:33:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x1f6c40e3e09ec730 [04/18/2023-18:33:04] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(12800,400:32,20,1) long-strided *************** [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool (TiledPooling) [04/18/2023-18:33:04] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool (CudaPooling) [04/18/2023-18:33:04] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool (CaskPooling) [04/18/2023-18:33:04] [V] [TRT] /model.31/m/MaxPool Set Tactic Name: sm72_xmma_pooling_IMMA_NCxHW32_generic_kMAX Tactic: 0x94215b398b8eb3ba [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x94215b398b8eb3ba Time: 0.00635846 [04/18/2023-18:33:04] [V] [TRT] Fastest Tactic: 0x94215b398b8eb3ba Time: 0.00635846 [04/18/2023-18:33:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x94215b398b8eb3ba [04/18/2023-18:33:04] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool (TiledPooling) [04/18/2023-18:33:04] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool (CudaPooling) [04/18/2023-18:33:04] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.31/m/MaxPool (CaskPooling) [04/18/2023-18:33:04] [V] [TRT] /model.31/m/MaxPool Set Tactic Name: sm72_xmma_pooling_IMMA_NCxHW32_generic_kMAX Tactic: 0x94215b398b8eb3ba [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x94215b398b8eb3ba Time: 0.00633799 [04/18/2023-18:33:04] [V] [TRT] Fastest Tactic: 0x94215b398b8eb3ba Time: 0.00633799 [04/18/2023-18:33:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x94215b398b8eb3ba [04/18/2023-18:33:04] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:04] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(102400,400:4,20,1) long-strided *************** [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.32/m/MaxPool (TiledPooling) [04/18/2023-18:33:04] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.32/m/MaxPool (CudaPooling) [04/18/2023-18:33:04] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.32/m/MaxPool (CaskPooling) [04/18/2023-18:33:04] [V] [TRT] /model.32/m/MaxPool Set Tactic Name: sm50_xmma_pooling_CHWPacked_NCxHW4_kMAX Tactic: 0x1f6c40e3e09ec730 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x1f6c40e3e09ec730 Time: 0.0111223 [04/18/2023-18:33:04] [V] [TRT] Fastest Tactic: 0x1f6c40e3e09ec730 Time: 0.0111223 [04/18/2023-18:33:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x1f6c40e3e09ec730 [04/18/2023-18:33:04] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.32/m/MaxPool (TiledPooling) [04/18/2023-18:33:04] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.32/m/MaxPool (CudaPooling) [04/18/2023-18:33:04] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.32/m/MaxPool (CaskPooling) [04/18/2023-18:33:04] [V] [TRT] /model.32/m/MaxPool Set Tactic Name: sm50_xmma_pooling_CHWPacked_NCxHW4_kMAX Tactic: 0x1f6c40e3e09ec730 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x1f6c40e3e09ec730 Time: 0.0111124 [04/18/2023-18:33:04] [V] [TRT] Fastest Tactic: 0x1f6c40e3e09ec730 Time: 0.0111124 [04/18/2023-18:33:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x1f6c40e3e09ec730 [04/18/2023-18:33:04] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(12800,400:32,20,1) long-strided *************** [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.32/m/MaxPool (TiledPooling) [04/18/2023-18:33:04] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.32/m/MaxPool (CudaPooling) [04/18/2023-18:33:04] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.32/m/MaxPool (CaskPooling) [04/18/2023-18:33:04] [V] [TRT] /model.32/m/MaxPool Set Tactic Name: sm72_xmma_pooling_IMMA_NCxHW32_generic_kMAX Tactic: 0x94215b398b8eb3ba [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x94215b398b8eb3ba Time: 0.0123162 [04/18/2023-18:33:04] [V] [TRT] Fastest Tactic: 0x94215b398b8eb3ba Time: 0.0123162 [04/18/2023-18:33:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x94215b398b8eb3ba [04/18/2023-18:33:04] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.32/m/MaxPool (TiledPooling) [04/18/2023-18:33:04] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.32/m/MaxPool (CudaPooling) [04/18/2023-18:33:04] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.32/m/MaxPool (CaskPooling) [04/18/2023-18:33:04] [V] [TRT] /model.32/m/MaxPool Set Tactic Name: sm72_xmma_pooling_IMMA_NCxHW32_generic_kMAX Tactic: 0x94215b398b8eb3ba [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x94215b398b8eb3ba Time: 0.0123276 [04/18/2023-18:33:04] [V] [TRT] Fastest Tactic: 0x94215b398b8eb3ba Time: 0.0123276 [04/18/2023-18:33:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x94215b398b8eb3ba [04/18/2023-18:33:04] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:04] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(102400,400:4,20,1) long-strided *************** [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.33/m/MaxPool (TiledPooling) [04/18/2023-18:33:04] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.33/m/MaxPool (CudaPooling) [04/18/2023-18:33:04] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.33/m/MaxPool (CaskPooling) [04/18/2023-18:33:04] [V] [TRT] /model.33/m/MaxPool Set Tactic Name: sm50_xmma_pooling_CHWPacked_NCxHW4_kMAX Tactic: 0x1f6c40e3e09ec730 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x1f6c40e3e09ec730 Time: 0.0190171 [04/18/2023-18:33:04] [V] [TRT] Fastest Tactic: 0x1f6c40e3e09ec730 Time: 0.0190171 [04/18/2023-18:33:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x1f6c40e3e09ec730 [04/18/2023-18:33:04] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.33/m/MaxPool (TiledPooling) [04/18/2023-18:33:04] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.33/m/MaxPool (CudaPooling) [04/18/2023-18:33:04] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.33/m/MaxPool (CaskPooling) [04/18/2023-18:33:04] [V] [TRT] /model.33/m/MaxPool Set Tactic Name: sm50_xmma_pooling_CHWPacked_NCxHW4_kMAX Tactic: 0x1f6c40e3e09ec730 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x1f6c40e3e09ec730 Time: 0.0190354 [04/18/2023-18:33:04] [V] [TRT] Fastest Tactic: 0x1f6c40e3e09ec730 Time: 0.0190354 [04/18/2023-18:33:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x1f6c40e3e09ec730 [04/18/2023-18:33:04] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(12800,400:32,20,1) long-strided *************** [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.33/m/MaxPool (TiledPooling) [04/18/2023-18:33:04] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.33/m/MaxPool (CudaPooling) [04/18/2023-18:33:04] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.33/m/MaxPool (CaskPooling) [04/18/2023-18:33:04] [V] [TRT] /model.33/m/MaxPool Set Tactic Name: sm72_xmma_pooling_IMMA_NCxHW32_generic_kMAX Tactic: 0x94215b398b8eb3ba [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x94215b398b8eb3ba Time: 0.0206661 [04/18/2023-18:33:04] [V] [TRT] Fastest Tactic: 0x94215b398b8eb3ba Time: 0.0206661 [04/18/2023-18:33:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x94215b398b8eb3ba [04/18/2023-18:33:04] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.33/m/MaxPool (TiledPooling) [04/18/2023-18:33:04] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.33/m/MaxPool (CudaPooling) [04/18/2023-18:33:04] [V] [TRT] CudaPooling has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: /model.33/m/MaxPool (CaskPooling) [04/18/2023-18:33:04] [V] [TRT] /model.33/m/MaxPool Set Tactic Name: sm72_xmma_pooling_IMMA_NCxHW32_generic_kMAX Tactic: 0x94215b398b8eb3ba [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x94215b398b8eb3ba Time: 0.0206126 [04/18/2023-18:33:04] [V] [TRT] Fastest Tactic: 0x94215b398b8eb3ba Time: 0.0206126 [04/18/2023-18:33:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 0x94215b398b8eb3ba [04/18/2023-18:33:04] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:04] [V] [TRT] *************** Autotuning format combination: Int8(409600,400,20,1) -> Int8(204800,400,20,1) long-strided *************** [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:04] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] *************** Autotuning format combination: Int8(409600,400,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:04] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] *************** Autotuning format combination: Int8(102400,400:4,20,1) -> Int8(51200,400:4,20,1) long-strided *************** [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:04] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:04] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:04] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] *************** Autotuning format combination: Int8(102400,400:4,20,1) -> Int8(6400,400:32,20,1) long-strided *************** [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:04] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] *************** Autotuning format combination: Int8(102400,400:4,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:04] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:04] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:04] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] *************** Autotuning format combination: Int8(102400,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:04] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] *************** Autotuning format combination: Int8(12800,400:32,20,1) -> Int8(6400,400:32,20,1) long-strided *************** [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:33:04] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:04] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:04] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:04] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00787681 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00802514 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00804241 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00730126 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00761239 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00703739 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00708637 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00759074 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.0097341 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00993158 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00985387 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0102482 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0284038 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.0104173 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.0107673 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.0167888 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00719977 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.0169493 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.0169001 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0171027 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.02808 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.0069662 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00694291 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00864914 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.011129 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0280648 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0121661 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0104274 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0193474 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0288695 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00975878 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00787008 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00995108 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00690438 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0284526 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0282819 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0183166 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0107161 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00806095 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00757293 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0280869 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0278941 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0179291 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.017153 [04/18/2023-18:33:04] [V] [TRT] Fastest Tactic: 0x6eb8c2607f51ccff Time: 0.00690438 [04/18/2023-18:33:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:33:04] [V] [TRT] *************** Autotuning format combination: Int8(12800,400:32,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:33:04] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:04] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:04] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:04] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00787994 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00800686 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00805968 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.0073232 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00762105 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00703042 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00709529 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00757173 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00958476 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00992792 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00973897 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0102547 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0277455 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.0104075 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.0107572 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.0168183 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00717943 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.0169351 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.0166827 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0173917 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0280891 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00696599 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00695118 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00868975 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0110984 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0281112 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0121417 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0104271 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.019312 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0288768 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00976975 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00789871 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.0099264 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00691614 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0284876 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0282491 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0183171 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0106717 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00804241 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00766845 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0280091 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0278903 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:33:04] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0178977 [04/18/2023-18:33:04] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-18:33:04] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.0171439 [04/18/2023-18:33:04] [V] [TRT] Fastest Tactic: 0x6eb8c2607f51ccff Time: 0.00691614 [04/18/2023-18:33:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:33:04] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:04] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Float(204800,400,20,1) long-strided *************** [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:04] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:04] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:04] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:04] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 0xc25454de2efcccdc [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xc25454de2efcccdc Time: 0.0209816 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: 0xff6944b17d5b2e32 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xff6944b17d5b2e32 Time: 0.0214831 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.0313929 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.0228833 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.0253768 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0228833 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.0308891 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0212114 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 0x1db6e8cf1382fbe0 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x1db6e8cf1382fbe0 Time: 0.030603 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: 0xa4ae2d82115c3e83 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xa4ae2d82115c3e83 Time: 0.0244785 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.0221727 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.026205 [04/18/2023-18:33:05] [V] [TRT] Fastest Tactic: 0xc25454de2efcccdc Time: 0.0209816 [04/18/2023-18:33:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xc25454de2efcccdc [04/18/2023-18:33:05] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Float(102400,400,20,1) *************** [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 0xc25454de2efcccdc [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xc25454de2efcccdc Time: 0.0208105 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: 0xff6944b17d5b2e32 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xff6944b17d5b2e32 Time: 0.0209953 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.0309833 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.0225313 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.0252053 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0227572 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.0308078 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0213577 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 0x1db6e8cf1382fbe0 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x1db6e8cf1382fbe0 Time: 0.0304567 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: 0xa4ae2d82115c3e83 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xa4ae2d82115c3e83 Time: 0.0243078 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.0219781 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.0261371 [04/18/2023-18:33:05] [V] [TRT] Fastest Tactic: 0xc25454de2efcccdc Time: 0.0208105 [04/18/2023-18:33:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xc25454de2efcccdc [04/18/2023-18:33:05] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Float(204800,400,20,1) long-strided *************** [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x733ba2a91a48d431 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x733ba2a91a48d431 Time: 0.00987886 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0xf04572b287451f42 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xf04572b287451f42 Time: 0.0125497 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x5e4f6d7c83746fd6 Time: 0.00958629 [04/18/2023-18:33:05] [V] [TRT] Fastest Tactic: 0x5e4f6d7c83746fd6 Time: 0.00958629 [04/18/2023-18:33:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-18:33:05] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Float(6400,400:32,20,1) long-strided *************** [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskJitConv) [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xc22b2f91e37e472a [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xc22b2f91e37e472a Time: 0.00617428 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x716fcb85e712b30e [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x716fcb85e712b30e Time: 0.020264 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x5e4918ccf433630e [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x5e4918ccf433630e Time: 0.0121406 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xfac85bfa6e8a95c6 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xfac85bfa6e8a95c6 Time: 0.00835378 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0216581 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x2640501019a61dc2 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x2640501019a61dc2 Time: 0.0080927 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00610629 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xffb9fbd2bfa6c47d [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xffb9fbd2bfa6c47d Time: 0.00851469 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.00870292 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x31de506085a332d4 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x31de506085a332d4 Time: 0.0059275 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x599d6bb582ecb830 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x599d6bb582ecb830 Time: 0.00809981 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.0063845 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x601b41d38fc4645b [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x601b41d38fc4645b Time: 0.0125112 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x311b82feb19aef19 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x311b82feb19aef19 Time: 0.00652613 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xd9c6b8a2f7935fa5 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xd9c6b8a2f7935fa5 Time: 0.00871018 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x4f35593c356e2e7e [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x4f35593c356e2e7e Time: 0.0125676 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x596666386c88024b [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x596666386c88024b Time: 0.00608629 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0209411 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0130959 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x3ffcb62b1c6bb94f Time: 0.00793335 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcddae68de84cc6ee [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xcddae68de84cc6ee Time: 0.00610762 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00844101 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdfdddae7a4bcc830 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xdfdddae7a4bcc830 Time: 0.0208144 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xcae7b5888d47fe1f [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xcae7b5888d47fe1f Time: 0.00572325 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x7247cc5dea3981f1 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x7247cc5dea3981f1 Time: 0.0211657 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa5a7024b355e2bbc [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xa5a7024b355e2bbc Time: 0.0059222 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00667013 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.00913229 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x70ff342513dcddd5 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x70ff342513dcddd5 Time: 0.0205636 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00619924 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.0124133 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3912ca79eb9a8be1 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x3912ca79eb9a8be1 Time: 0.00610781 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5947ea3454b6a27b [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x5947ea3454b6a27b Time: 0.0129695 [04/18/2023-18:33:05] [V] [TRT] Fastest Tactic: 0xcae7b5888d47fe1f Time: 0.00572325 [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa71946688cad8664 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xa71946688cad8664 Time: 0.00888901 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x1e55f8b415964e81 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x1e55f8b415964e81 Time: 0.0151406 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.012845 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9003f5f7ff9b1aec [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x9003f5f7ff9b1aec Time: 0.0233012 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9ec201b34455146e [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x9ec201b34455146e Time: 0.00823848 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x91930a570b557437 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x91930a570b557437 Time: 0.0231758 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdf7e1bd6a496d667 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xdf7e1bd6a496d667 Time: 0.0150674 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6d377e4222886190 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x6d377e4222886190 Time: 0.00863866 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x271b998fe31732ef [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x271b998fe31732ef Time: 0.0109714 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.00921372 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x960e9baa2a6cad5b [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x960e9baa2a6cad5b Time: 0.00870803 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.00855153 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x84942841d92b0552 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x84942841d92b0552 Time: 0.0155616 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xbeb5d91e1874a437 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xbeb5d91e1874a437 Time: 0.0148018 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcd229658c16b33cd [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xcd229658c16b33cd Time: 0.023631 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.0109593 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.0109499 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x33a5c6dd086942c1 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x33a5c6dd086942c1 Time: 0.00828953 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7720f198395e7d3d [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x7720f198395e7d3d Time: 0.0108072 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.0236356 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.0150482 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x60b880e28fee7a0c [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x60b880e28fee7a0c Time: 0.0232771 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcf64a2ae51bf6b36 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xcf64a2ae51bf6b36 Time: 0.00846171 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x844ea9c00f711f19 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x844ea9c00f711f19 Time: 0.0106789 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x65fbe45b4cb1d8a5 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x65fbe45b4cb1d8a5 Time: 0.00839314 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.00853163 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.00894114 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5bd8221bd57baf93 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x5bd8221bd57baf93 Time: 0.0088804 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0239573 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.00930829 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.0155762 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6e9c17a33c93d9b0 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x6e9c17a33c93d9b0 Time: 0.0105734 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.0163027 [04/18/2023-18:33:05] [V] [TRT] Fastest Tactic: 0x9ec201b34455146e Time: 0.00823848 [04/18/2023-18:33:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0xcae7b5888d47fe1f [04/18/2023-18:33:05] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Half(6400,400:32,20,1) long-strided *************** [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskJitConv) [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xc22b2f91e37e472a [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xc22b2f91e37e472a Time: 0.00571886 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x716fcb85e712b30e [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x716fcb85e712b30e Time: 0.0158811 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x5e4918ccf433630e [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x5e4918ccf433630e Time: 0.0101547 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xfac85bfa6e8a95c6 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xfac85bfa6e8a95c6 Time: 0.00740389 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.017184 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x2640501019a61dc2 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x2640501019a61dc2 Time: 0.00707527 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00604038 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xffb9fbd2bfa6c47d [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xffb9fbd2bfa6c47d Time: 0.00749326 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.00770815 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x31de506085a332d4 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x31de506085a332d4 Time: 0.00557644 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x599d6bb582ecb830 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x599d6bb582ecb830 Time: 0.00728023 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00614305 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x601b41d38fc4645b [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x601b41d38fc4645b Time: 0.0105218 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x311b82feb19aef19 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x311b82feb19aef19 Time: 0.00588617 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xd9c6b8a2f7935fa5 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xd9c6b8a2f7935fa5 Time: 0.00789847 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x4f35593c356e2e7e [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x4f35593c356e2e7e Time: 0.0105933 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x596666386c88024b [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x596666386c88024b Time: 0.00564607 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0165095 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0111177 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x3ffcb62b1c6bb94f Time: 0.00716617 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcddae68de84cc6ee [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xcddae68de84cc6ee Time: 0.00595543 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00740503 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdfdddae7a4bcc830 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xdfdddae7a4bcc830 Time: 0.0164978 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xcae7b5888d47fe1f [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xcae7b5888d47fe1f Time: 0.00570813 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x7247cc5dea3981f1 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x7247cc5dea3981f1 Time: 0.0168411 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa5a7024b355e2bbc [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xa5a7024b355e2bbc Time: 0.00586295 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00635925 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.00824559 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x70ff342513dcddd5 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x70ff342513dcddd5 Time: 0.0161239 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00569424 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.0104767 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3912ca79eb9a8be1 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x3912ca79eb9a8be1 Time: 0.00593152 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5947ea3454b6a27b [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x5947ea3454b6a27b Time: 0.0109704 [04/18/2023-18:33:05] [V] [TRT] Fastest Tactic: 0x31de506085a332d4 Time: 0.00557644 [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0x31de506085a332d4 [04/18/2023-18:33:05] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Float(102400,400,20,1) *************** [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x733ba2a91a48d431 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x733ba2a91a48d431 Time: 0.0096189 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0xf04572b287451f42 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xf04572b287451f42 Time: 0.0124198 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x5e4f6d7c83746fd6 Time: 0.00944572 [04/18/2023-18:33:05] [V] [TRT] Fastest Tactic: 0x5e4f6d7c83746fd6 Time: 0.00944572 [04/18/2023-18:33:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-18:33:05] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskJitConv) [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xc22b2f91e37e472a [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xc22b2f91e37e472a Time: 0.00621138 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x716fcb85e712b30e [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x716fcb85e712b30e Time: 0.0202789 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x5e4918ccf433630e [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x5e4918ccf433630e Time: 0.012149 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xfac85bfa6e8a95c6 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xfac85bfa6e8a95c6 Time: 0.00837257 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.021634 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x2640501019a61dc2 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x2640501019a61dc2 Time: 0.00810743 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.006112 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xffb9fbd2bfa6c47d [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xffb9fbd2bfa6c47d Time: 0.00853136 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.00872309 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x31de506085a332d4 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x31de506085a332d4 Time: 0.00594322 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x599d6bb582ecb830 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x599d6bb582ecb830 Time: 0.00810667 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00630817 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x601b41d38fc4645b [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x601b41d38fc4645b Time: 0.0125505 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x311b82feb19aef19 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x311b82feb19aef19 Time: 0.00642246 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xd9c6b8a2f7935fa5 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xd9c6b8a2f7935fa5 Time: 0.00873681 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x4f35593c356e2e7e [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x4f35593c356e2e7e Time: 0.0117767 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x596666386c88024b [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x596666386c88024b Time: 0.00538006 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0185011 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.011565 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x3ffcb62b1c6bb94f Time: 0.00702694 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcddae68de84cc6ee [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xcddae68de84cc6ee Time: 0.00540901 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00743291 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdfdddae7a4bcc830 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xdfdddae7a4bcc830 Time: 0.0183606 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xcae7b5888d47fe1f [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xcae7b5888d47fe1f Time: 0.00509178 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x7247cc5dea3981f1 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x7247cc5dea3981f1 Time: 0.0187611 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa5a7024b355e2bbc [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xa5a7024b355e2bbc Time: 0.00521894 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00591945 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.008064 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x70ff342513dcddd5 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x70ff342513dcddd5 Time: 0.018228 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00543086 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.0109809 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3912ca79eb9a8be1 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x3912ca79eb9a8be1 Time: 0.0053291 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5947ea3454b6a27b [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x5947ea3454b6a27b Time: 0.0115059 [04/18/2023-18:33:05] [V] [TRT] Fastest Tactic: 0xcae7b5888d47fe1f Time: 0.00509178 [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa71946688cad8664 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xa71946688cad8664 Time: 0.00770791 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x1e55f8b415964e81 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x1e55f8b415964e81 Time: 0.0133739 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.0111919 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9003f5f7ff9b1aec [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x9003f5f7ff9b1aec Time: 0.0205414 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9ec201b34455146e [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x9ec201b34455146e Time: 0.00717326 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x91930a570b557437 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x91930a570b557437 Time: 0.0203543 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdf7e1bd6a496d667 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xdf7e1bd6a496d667 Time: 0.0132646 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6d377e4222886190 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x6d377e4222886190 Time: 0.0074992 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x271b998fe31732ef [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x271b998fe31732ef Time: 0.0096064 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.00803886 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x960e9baa2a6cad5b [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x960e9baa2a6cad5b Time: 0.0075905 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.00744 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x84942841d92b0552 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x84942841d92b0552 Time: 0.0136952 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xbeb5d91e1874a437 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xbeb5d91e1874a437 Time: 0.0130888 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcd229658c16b33cd [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xcd229658c16b33cd Time: 0.0208131 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.00958233 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.0096061 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x33a5c6dd086942c1 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x33a5c6dd086942c1 Time: 0.00721691 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7720f198395e7d3d [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x7720f198395e7d3d Time: 0.00947772 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.0208196 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.0132414 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x60b880e28fee7a0c [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x60b880e28fee7a0c Time: 0.0205113 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcf64a2ae51bf6b36 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xcf64a2ae51bf6b36 Time: 0.00736754 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x844ea9c00f711f19 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x844ea9c00f711f19 Time: 0.009352 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x65fbe45b4cb1d8a5 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x65fbe45b4cb1d8a5 Time: 0.0073008 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.007488 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.00779597 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5bd8221bd57baf93 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x5bd8221bd57baf93 Time: 0.00766701 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0211089 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.00811683 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.0137101 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6e9c17a33c93d9b0 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x6e9c17a33c93d9b0 Time: 0.00926314 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.0142475 [04/18/2023-18:33:05] [V] [TRT] Fastest Tactic: 0x9ec201b34455146e Time: 0.00717326 [04/18/2023-18:33:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0xcae7b5888d47fe1f [04/18/2023-18:33:05] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskJitConv) [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xc22b2f91e37e472a [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xc22b2f91e37e472a Time: 0.00506168 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x716fcb85e712b30e [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x716fcb85e712b30e Time: 0.0140384 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x5e4918ccf433630e [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x5e4918ccf433630e Time: 0.00903343 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xfac85bfa6e8a95c6 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xfac85bfa6e8a95c6 Time: 0.00656644 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0152151 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x2640501019a61dc2 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x2640501019a61dc2 Time: 0.00625868 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00535399 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xffb9fbd2bfa6c47d [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xffb9fbd2bfa6c47d Time: 0.00665101 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.00681687 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x31de506085a332d4 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x31de506085a332d4 Time: 0.00504875 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x599d6bb582ecb830 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x599d6bb582ecb830 Time: 0.00644293 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00540698 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x601b41d38fc4645b [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x601b41d38fc4645b Time: 0.009342 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x311b82feb19aef19 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x311b82feb19aef19 Time: 0.00517796 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xd9c6b8a2f7935fa5 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xd9c6b8a2f7935fa5 Time: 0.00698449 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x4f35593c356e2e7e [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x4f35593c356e2e7e Time: 0.00934886 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x596666386c88024b [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x596666386c88024b Time: 0.00492642 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0146386 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.00983497 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x3ffcb62b1c6bb94f Time: 0.00636542 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcddae68de84cc6ee [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xcddae68de84cc6ee Time: 0.00523706 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00654857 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdfdddae7a4bcc830 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xdfdddae7a4bcc830 Time: 0.0145541 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xcae7b5888d47fe1f [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xcae7b5888d47fe1f Time: 0.0050642 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x7247cc5dea3981f1 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x7247cc5dea3981f1 Time: 0.0148617 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa5a7024b355e2bbc [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xa5a7024b355e2bbc Time: 0.00515853 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00564677 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.00731428 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x70ff342513dcddd5 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x70ff342513dcddd5 Time: 0.0143378 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00498223 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.00928914 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3912ca79eb9a8be1 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x3912ca79eb9a8be1 Time: 0.00511918 [04/18/2023-18:33:05] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5947ea3454b6a27b [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x5947ea3454b6a27b Time: 0.00969722 [04/18/2023-18:33:05] [V] [TRT] Fastest Tactic: 0x596666386c88024b Time: 0.00492642 [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0x596666386c88024b [04/18/2023-18:33:05] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:05] [V] [TRT] *************** Autotuning format combination: Int8(102400,400,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:05] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(12800,400:4,20,1) *************** [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:05] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:05] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:05] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:33:05] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:05] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:05] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:05] [V] [TRT] --------------- Timing Runner: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00396763 [04/18/2023-18:33:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00408281 [04/18/2023-18:33:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00421553 [04/18/2023-18:33:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00429069 [04/18/2023-18:33:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00466669 [04/18/2023-18:33:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00434057 [04/18/2023-18:33:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00442708 [04/18/2023-18:33:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00459657 [04/18/2023-18:33:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00518547 [04/18/2023-18:33:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00544186 [04/18/2023-18:33:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00523526 [04/18/2023-18:33:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00558558 [04/18/2023-18:33:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0112485 [04/18/2023-18:33:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00569618 [04/18/2023-18:33:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.0060541 [04/18/2023-18:33:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00842837 [04/18/2023-18:33:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00435851 [04/18/2023-18:33:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.00861311 [04/18/2023-18:33:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00829917 [04/18/2023-18:33:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00856471 [04/18/2023-18:33:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0114395 [04/18/2023-18:33:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00431113 [04/18/2023-18:33:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.0049024 [04/18/2023-18:33:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00484709 [04/18/2023-18:33:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00627101 [04/18/2023-18:33:05] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:33:05] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0115967 [04/18/2023-18:33:06] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00676551 [04/18/2023-18:33:06] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00621516 [04/18/2023-18:33:06] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.009498 [04/18/2023-18:33:06] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0123966 [04/18/2023-18:33:06] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00545795 [04/18/2023-18:33:06] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0043876 [04/18/2023-18:33:06] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00544305 [04/18/2023-18:33:06] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.0044063 [04/18/2023-18:33:06] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.012189 [04/18/2023-18:33:06] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.011872 [04/18/2023-18:33:06] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00934057 [04/18/2023-18:33:06] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00580462 [04/18/2023-18:33:06] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00471698 [04/18/2023-18:33:06] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00449829 [04/18/2023-18:33:06] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0119112 [04/18/2023-18:33:06] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0116164 [04/18/2023-18:33:06] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00920743 [04/18/2023-18:33:06] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00876854 [04/18/2023-18:33:06] [V] [TRT] Fastest Tactic: 0xeb1602207b0c3d49 Time: 0.00396763 [04/18/2023-18:33:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:33:06] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:06] [V] [TRT] *************** Autotuning format combination: Int8(51200,400,20,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: /model.39/Resize (Resize) [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00486141 [04/18/2023-18:33:06] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00486141 [04/18/2023-18:33:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000000 [04/18/2023-18:33:06] [V] [TRT] *************** Autotuning format combination: Int8(1600,400:32,20,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: /model.39/Resize (Resize) [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00341322 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00333183 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00348767 [04/18/2023-18:33:06] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.00333183 [04/18/2023-18:33:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000005 [04/18/2023-18:33:06] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:06] [V] [TRT] *************** Autotuning format combination: Int8(409600,1600,40,1) -> Int8(409600,1600,40,1) long-strided *************** [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] *************** Autotuning format combination: Int8(409600,1600,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(102400,1600:4,40,1) long-strided *************** [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(12800,1600:32,40,1) long-strided *************** [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Int8(12800,1600:32,40,1) long-strided *************** [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:33:06] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00514531 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00520376 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00532859 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.0047242 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0048864 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00476892 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00466448 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.0047043 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00515526 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00549181 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00535484 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00566927 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0111807 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00577536 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00614647 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00874165 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00465091 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.00827657 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00810895 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00831492 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0115116 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00462289 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00464811 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00488031 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00632407 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0115963 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00628671 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00559455 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0096061 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.012205 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00528179 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00508769 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00574135 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00478019 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.011834 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0118326 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00922143 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00574976 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00476739 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00472302 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0116934 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0116455 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00926886 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00894628 [04/18/2023-18:33:06] [V] [TRT] Fastest Tactic: 0x0779fa4ac8f9f2ee Time: 0.00462289 [04/18/2023-18:33:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:33:06] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:33:06] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00497372 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00506861 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00520196 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.0047186 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0048608 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00471403 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.004571 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00472951 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00515559 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00545354 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.0053848 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00567807 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0111821 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00577701 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00615009 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00864 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00478918 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.00825092 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00807365 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00831391 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0115168 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00451043 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00451543 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.004896 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00631573 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0115727 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00628035 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00558523 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00959695 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0122827 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00533181 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00500997 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00561741 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00458257 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.011852 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0118393 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00924257 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00576366 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00486172 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00484328 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0117138 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0116086 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00931029 [04/18/2023-18:33:06] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00886965 [04/18/2023-18:33:06] [V] [TRT] Fastest Tactic: 0x0779fa4ac8f9f2ee Time: 0.00451043 [04/18/2023-18:33:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:33:06] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:06] [V] [TRT] *************** Autotuning format combination: Int8(409600,1600,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear + /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear + /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear + /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear + /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear + /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear + /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear + /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear + /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:33:06] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:06] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:4,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] *************** Autotuning format combination: Int8(3200,1600:32,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:33:06] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:06] [V] [TRT] --------------- Timing Runner: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.00559191 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00583973 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00564237 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.00539869 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00552123 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.00534739 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00560053 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.00666805 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00693094 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00723109 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0110428 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.00686563 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.00705676 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0112651 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0172922 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00670899 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00766147 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0170667 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0172302 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:33:06] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00848457 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00748937 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0132721 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0175543 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.00577188 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00578487 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0175751 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0174669 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.012392 [04/18/2023-18:33:06] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:33:06] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0076557 [04/18/2023-18:33:07] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00598324 [04/18/2023-18:33:07] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00575671 [04/18/2023-18:33:07] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0122674 [04/18/2023-18:33:07] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0115481 [04/18/2023-18:33:07] [V] [TRT] Fastest Tactic: 0xa085d13614221ec4 Time: 0.00534739 [04/18/2023-18:33:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa085d13614221ec4 [04/18/2023-18:33:07] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:07] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600,40,1) -> Int8(409600,1600,40,1) long-strided *************** [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:4,40,1) -> Int8(102400,1600:4,40,1) long-strided *************** [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:07] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:4,40,1) -> Int8(12800,1600:32,40,1) long-strided *************** [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:4,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:07] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] *************** Autotuning format combination: Int8(3200,1600:32,40,1) -> Int8(12800,1600:32,40,1) long-strided *************** [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:33:07] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:07] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.00562796 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00605429 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00565539 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.00544423 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00567508 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.00535585 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00563165 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.00673226 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00694574 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0072304 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0109964 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.00688044 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.00702716 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0112724 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0171886 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00638748 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00779068 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.017213 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0172216 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00844746 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00745257 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0131695 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0175756 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.00532368 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00576475 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0175761 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0176361 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0123539 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0076711 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00599962 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00577061 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.012149 [04/18/2023-18:33:07] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0115668 [04/18/2023-18:33:07] [V] [TRT] Fastest Tactic: 0x5e921a04a7b0e583 Time: 0.00532368 [04/18/2023-18:33:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:33:07] [V] [TRT] *************** Autotuning format combination: Int8(3200,1600:32,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:33:07] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:07] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Float(409600,1600,40,1) long-strided *************** [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 0xc25454de2efcccdc [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xc25454de2efcccdc Time: 0.0142176 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: 0xff6944b17d5b2e32 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xff6944b17d5b2e32 Time: 0.0143529 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.0190326 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.0150633 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.015934 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0150117 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.0191154 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0142782 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 0x1db6e8cf1382fbe0 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x1db6e8cf1382fbe0 Time: 0.018964 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: 0xa4ae2d82115c3e83 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xa4ae2d82115c3e83 Time: 0.0155845 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.0149106 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.0163911 [04/18/2023-18:33:07] [V] [TRT] Fastest Tactic: 0xc25454de2efcccdc Time: 0.0142176 [04/18/2023-18:33:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xc25454de2efcccdc [04/18/2023-18:33:07] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Float(204800,1600,40,1) *************** [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 0xc25454de2efcccdc [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xc25454de2efcccdc Time: 0.0139237 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: 0xff6944b17d5b2e32 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xff6944b17d5b2e32 Time: 0.0140829 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.0188709 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.014848 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.0157522 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0149737 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.01892 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0141186 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 0x1db6e8cf1382fbe0 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x1db6e8cf1382fbe0 Time: 0.0186697 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: 0xa4ae2d82115c3e83 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xa4ae2d82115c3e83 Time: 0.0152969 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.0146683 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.0162971 [04/18/2023-18:33:07] [V] [TRT] Fastest Tactic: 0xc25454de2efcccdc Time: 0.0139237 [04/18/2023-18:33:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xc25454de2efcccdc [04/18/2023-18:33:07] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Float(409600,1600,40,1) long-strided *************** [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x733ba2a91a48d431 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x733ba2a91a48d431 Time: 0.00883415 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0xf04572b287451f42 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xf04572b287451f42 Time: 0.0104624 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x5e4f6d7c83746fd6 Time: 0.009202 [04/18/2023-18:33:07] [V] [TRT] Fastest Tactic: 0x733ba2a91a48d431 Time: 0.00883415 [04/18/2023-18:33:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x733ba2a91a48d431 [04/18/2023-18:33:07] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Float(12800,1600:32,40,1) long-strided *************** [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskJitConv) [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xc22b2f91e37e472a [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xc22b2f91e37e472a Time: 0.00571446 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x716fcb85e712b30e [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x716fcb85e712b30e Time: 0.0108434 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x5e4918ccf433630e [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x5e4918ccf433630e Time: 0.00875859 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xfac85bfa6e8a95c6 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xfac85bfa6e8a95c6 Time: 0.00651865 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0148635 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x2640501019a61dc2 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x2640501019a61dc2 Time: 0.00624835 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00606076 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xffb9fbd2bfa6c47d [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xffb9fbd2bfa6c47d Time: 0.00675117 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.0065039 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x31de506085a332d4 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x31de506085a332d4 Time: 0.00627438 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x599d6bb582ecb830 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x599d6bb582ecb830 Time: 0.00652966 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00628392 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x601b41d38fc4645b [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x601b41d38fc4645b Time: 0.00908514 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x311b82feb19aef19 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x311b82feb19aef19 Time: 0.00600248 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xd9c6b8a2f7935fa5 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xd9c6b8a2f7935fa5 Time: 0.00689176 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x4f35593c356e2e7e [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x4f35593c356e2e7e Time: 0.00902286 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x596666386c88024b [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x596666386c88024b Time: 0.00629863 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0112418 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.00949886 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x3ffcb62b1c6bb94f Time: 0.00640099 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcddae68de84cc6ee [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xcddae68de84cc6ee Time: 0.00608286 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00667242 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdfdddae7a4bcc830 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xdfdddae7a4bcc830 Time: 0.0114029 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xcae7b5888d47fe1f [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xcae7b5888d47fe1f Time: 0.00602895 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x7247cc5dea3981f1 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x7247cc5dea3981f1 Time: 0.0145202 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa5a7024b355e2bbc [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xa5a7024b355e2bbc Time: 0.00585948 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00611219 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.00708006 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x70ff342513dcddd5 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x70ff342513dcddd5 Time: 0.0141872 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00656 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.00881909 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3912ca79eb9a8be1 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x3912ca79eb9a8be1 Time: 0.00604686 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5947ea3454b6a27b [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x5947ea3454b6a27b Time: 0.00938371 [04/18/2023-18:33:07] [V] [TRT] Fastest Tactic: 0xc22b2f91e37e472a Time: 0.00571446 [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa71946688cad8664 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xa71946688cad8664 Time: 0.00832508 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x1e55f8b415964e81 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x1e55f8b415964e81 Time: 0.0115302 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.010059 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9003f5f7ff9b1aec [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x9003f5f7ff9b1aec Time: 0.0168264 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9ec201b34455146e [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x9ec201b34455146e Time: 0.00859912 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x91930a570b557437 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x91930a570b557437 Time: 0.0134221 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdf7e1bd6a496d667 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xdf7e1bd6a496d667 Time: 0.0115246 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6d377e4222886190 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x6d377e4222886190 Time: 0.00904171 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x271b998fe31732ef [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x271b998fe31732ef Time: 0.00923286 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.00879139 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x960e9baa2a6cad5b [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x960e9baa2a6cad5b Time: 0.00823898 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.00898171 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x84942841d92b0552 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x84942841d92b0552 Time: 0.0119051 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xbeb5d91e1874a437 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xbeb5d91e1874a437 Time: 0.0112461 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcd229658c16b33cd [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xcd229658c16b33cd Time: 0.0171215 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.0089245 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.00917972 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x33a5c6dd086942c1 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x33a5c6dd086942c1 Time: 0.00883066 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7720f198395e7d3d [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x7720f198395e7d3d Time: 0.00878306 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.0139267 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.0114507 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x60b880e28fee7a0c [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x60b880e28fee7a0c Time: 0.0138385 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcf64a2ae51bf6b36 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xcf64a2ae51bf6b36 Time: 0.00895971 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x844ea9c00f711f19 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x844ea9c00f711f19 Time: 0.00891455 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x65fbe45b4cb1d8a5 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x65fbe45b4cb1d8a5 Time: 0.00885244 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.00888094 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.00877365 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5bd8221bd57baf93 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x5bd8221bd57baf93 Time: 0.00904486 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0174375 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.00888175 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.0120392 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6e9c17a33c93d9b0 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x6e9c17a33c93d9b0 Time: 0.00874057 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.012189 [04/18/2023-18:33:07] [V] [TRT] Fastest Tactic: 0x960e9baa2a6cad5b Time: 0.00823898 [04/18/2023-18:33:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0xc22b2f91e37e472a [04/18/2023-18:33:07] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Half(12800,1600:32,40,1) long-strided *************** [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskJitConv) [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xc22b2f91e37e472a [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xc22b2f91e37e472a Time: 0.00484495 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x716fcb85e712b30e [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x716fcb85e712b30e Time: 0.00954027 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x5e4918ccf433630e [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x5e4918ccf433630e Time: 0.00700386 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xfac85bfa6e8a95c6 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xfac85bfa6e8a95c6 Time: 0.00566857 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0110477 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x2640501019a61dc2 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x2640501019a61dc2 Time: 0.00542138 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00547623 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xffb9fbd2bfa6c47d [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xffb9fbd2bfa6c47d Time: 0.00582821 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.00576622 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x31de506085a332d4 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x31de506085a332d4 Time: 0.00552264 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x599d6bb582ecb830 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x599d6bb582ecb830 Time: 0.00589184 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00595486 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x601b41d38fc4645b [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x601b41d38fc4645b Time: 0.00733348 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x311b82feb19aef19 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x311b82feb19aef19 Time: 0.00514302 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xd9c6b8a2f7935fa5 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xd9c6b8a2f7935fa5 Time: 0.00619486 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x4f35593c356e2e7e [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x4f35593c356e2e7e Time: 0.00730423 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x596666386c88024b [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x596666386c88024b Time: 0.00557117 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.00993036 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.00783808 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x3ffcb62b1c6bb94f Time: 0.00577061 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcddae68de84cc6ee [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xcddae68de84cc6ee Time: 0.0058699 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00586679 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdfdddae7a4bcc830 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xdfdddae7a4bcc830 Time: 0.0101105 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xcae7b5888d47fe1f [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xcae7b5888d47fe1f Time: 0.00524294 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x7247cc5dea3981f1 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x7247cc5dea3981f1 Time: 0.0107399 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa5a7024b355e2bbc [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xa5a7024b355e2bbc Time: 0.00533706 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00540681 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.006432 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x70ff342513dcddd5 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x70ff342513dcddd5 Time: 0.0103758 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00579273 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.00729623 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3912ca79eb9a8be1 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x3912ca79eb9a8be1 Time: 0.00564325 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5947ea3454b6a27b [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x5947ea3454b6a27b Time: 0.0076545 [04/18/2023-18:33:07] [V] [TRT] Fastest Tactic: 0xc22b2f91e37e472a Time: 0.00484495 [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0xc22b2f91e37e472a [04/18/2023-18:33:07] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Float(204800,1600,40,1) *************** [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x733ba2a91a48d431 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x733ba2a91a48d431 Time: 0.00908314 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0xf04572b287451f42 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xf04572b287451f42 Time: 0.0104669 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x5e4f6d7c83746fd6 Time: 0.00907771 [04/18/2023-18:33:07] [V] [TRT] Fastest Tactic: 0x5e4f6d7c83746fd6 Time: 0.00907771 [04/18/2023-18:33:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-18:33:07] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Float(6400,1600:32,40,1) *************** [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskJitConv) [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xc22b2f91e37e472a [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xc22b2f91e37e472a Time: 0.00641352 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x716fcb85e712b30e [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x716fcb85e712b30e Time: 0.0109326 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x5e4918ccf433630e [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x5e4918ccf433630e Time: 0.00878387 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xfac85bfa6e8a95c6 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xfac85bfa6e8a95c6 Time: 0.00647235 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0149751 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x2640501019a61dc2 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x2640501019a61dc2 Time: 0.00659948 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00624419 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xffb9fbd2bfa6c47d [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xffb9fbd2bfa6c47d Time: 0.00688392 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.0065999 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x31de506085a332d4 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x31de506085a332d4 Time: 0.00635965 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x599d6bb582ecb830 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x599d6bb582ecb830 Time: 0.00656187 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00631573 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x601b41d38fc4645b [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x601b41d38fc4645b Time: 0.00913229 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x311b82feb19aef19 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x311b82feb19aef19 Time: 0.0060781 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xd9c6b8a2f7935fa5 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xd9c6b8a2f7935fa5 Time: 0.00696033 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x4f35593c356e2e7e [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x4f35593c356e2e7e Time: 0.00910457 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x596666386c88024b [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x596666386c88024b Time: 0.00633838 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.011373 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.00956861 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x3ffcb62b1c6bb94f Time: 0.0066346 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcddae68de84cc6ee [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xcddae68de84cc6ee Time: 0.00616324 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00672 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdfdddae7a4bcc830 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xdfdddae7a4bcc830 Time: 0.0115017 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xcae7b5888d47fe1f [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xcae7b5888d47fe1f Time: 0.00606324 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x7247cc5dea3981f1 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x7247cc5dea3981f1 Time: 0.0146313 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa5a7024b355e2bbc [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xa5a7024b355e2bbc Time: 0.00618724 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00611333 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.00717966 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x70ff342513dcddd5 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x70ff342513dcddd5 Time: 0.0143351 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00671605 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.00891966 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3912ca79eb9a8be1 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x3912ca79eb9a8be1 Time: 0.00599276 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5947ea3454b6a27b [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x5947ea3454b6a27b Time: 0.00941829 [04/18/2023-18:33:07] [V] [TRT] Fastest Tactic: 0x3912ca79eb9a8be1 Time: 0.00599276 [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa71946688cad8664 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xa71946688cad8664 Time: 0.0084238 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x1e55f8b415964e81 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x1e55f8b415964e81 Time: 0.0116153 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.00994255 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9003f5f7ff9b1aec [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x9003f5f7ff9b1aec Time: 0.0168025 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9ec201b34455146e [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x9ec201b34455146e Time: 0.00864511 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x91930a570b557437 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x91930a570b557437 Time: 0.0134134 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdf7e1bd6a496d667 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xdf7e1bd6a496d667 Time: 0.0114542 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6d377e4222886190 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x6d377e4222886190 Time: 0.00860746 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x271b998fe31732ef [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x271b998fe31732ef Time: 0.00919857 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.00875052 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x960e9baa2a6cad5b [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x960e9baa2a6cad5b Time: 0.0086037 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.00890998 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x84942841d92b0552 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x84942841d92b0552 Time: 0.011892 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xbeb5d91e1874a437 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xbeb5d91e1874a437 Time: 0.0112527 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcd229658c16b33cd [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xcd229658c16b33cd Time: 0.0170789 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.0088683 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.00911772 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x33a5c6dd086942c1 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x33a5c6dd086942c1 Time: 0.00878978 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7720f198395e7d3d [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x7720f198395e7d3d Time: 0.00878897 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.0139632 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.011444 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x60b880e28fee7a0c [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x60b880e28fee7a0c Time: 0.0137642 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcf64a2ae51bf6b36 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xcf64a2ae51bf6b36 Time: 0.00886534 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x844ea9c00f711f19 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x844ea9c00f711f19 Time: 0.00888713 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x65fbe45b4cb1d8a5 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x65fbe45b4cb1d8a5 Time: 0.00899886 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.00885217 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.0087239 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5bd8221bd57baf93 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x5bd8221bd57baf93 Time: 0.00857761 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0174568 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.00934429 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.0119954 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6e9c17a33c93d9b0 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x6e9c17a33c93d9b0 Time: 0.00873089 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.0121547 [04/18/2023-18:33:07] [V] [TRT] Fastest Tactic: 0xa71946688cad8664 Time: 0.0084238 [04/18/2023-18:33:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0x3912ca79eb9a8be1 [04/18/2023-18:33:07] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Half(6400,1600:32,40,1) *************** [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskJitConv) [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xc22b2f91e37e472a [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xc22b2f91e37e472a Time: 0.00483139 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x716fcb85e712b30e [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x716fcb85e712b30e Time: 0.00954758 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x5e4918ccf433630e [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x5e4918ccf433630e Time: 0.00700582 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xfac85bfa6e8a95c6 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xfac85bfa6e8a95c6 Time: 0.00568299 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0110502 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x2640501019a61dc2 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x2640501019a61dc2 Time: 0.00537837 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.0054676 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xffb9fbd2bfa6c47d [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xffb9fbd2bfa6c47d Time: 0.00580828 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.00571575 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x31de506085a332d4 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x31de506085a332d4 Time: 0.00549767 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x599d6bb582ecb830 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x599d6bb582ecb830 Time: 0.005888 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00594359 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x601b41d38fc4645b [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x601b41d38fc4645b Time: 0.00733737 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x311b82feb19aef19 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x311b82feb19aef19 Time: 0.00514759 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xd9c6b8a2f7935fa5 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xd9c6b8a2f7935fa5 Time: 0.00616952 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x4f35593c356e2e7e [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x4f35593c356e2e7e Time: 0.00730811 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x596666386c88024b [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x596666386c88024b Time: 0.00557275 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.00992488 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.00784481 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x3ffcb62b1c6bb94f Time: 0.00575872 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcddae68de84cc6ee [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xcddae68de84cc6ee Time: 0.00589568 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00587063 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdfdddae7a4bcc830 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xdfdddae7a4bcc830 Time: 0.0101035 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xcae7b5888d47fe1f [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xcae7b5888d47fe1f Time: 0.00521535 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x7247cc5dea3981f1 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x7247cc5dea3981f1 Time: 0.0107425 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa5a7024b355e2bbc [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xa5a7024b355e2bbc Time: 0.00532791 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00542408 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.00644412 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x70ff342513dcddd5 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x70ff342513dcddd5 Time: 0.0103899 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00576805 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.00727428 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3912ca79eb9a8be1 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x3912ca79eb9a8be1 Time: 0.00561389 [04/18/2023-18:33:07] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5947ea3454b6a27b [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x5947ea3454b6a27b Time: 0.00765065 [04/18/2023-18:33:07] [V] [TRT] Fastest Tactic: 0xc22b2f91e37e472a Time: 0.00483139 [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0xc22b2f91e37e472a [04/18/2023-18:33:07] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:07] [V] [TRT] *************** Autotuning format combination: Int8(204800,1600,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:07] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:33:07] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:07] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:07] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:07] [V] [TRT] --------------- Timing Runner: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.0046198 [04/18/2023-18:33:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00432928 [04/18/2023-18:33:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00446614 [04/18/2023-18:33:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00463086 [04/18/2023-18:33:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00444495 [04/18/2023-18:33:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00427052 [04/18/2023-18:33:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:33:07] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00412473 [04/18/2023-18:33:07] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00431704 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00459129 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00487771 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00472568 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00503614 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.00908114 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00497072 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00532758 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00751154 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00414211 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.00728617 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00702738 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00732137 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.00939857 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00409665 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00398057 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00429539 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00547657 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.00945257 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00532199 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00471064 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00817651 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.00996846 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00479573 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0042802 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.0049056 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00410815 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.00979566 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.00948972 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00797003 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00488122 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00422951 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00415987 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.00978072 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.00944257 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00803403 [04/18/2023-18:33:08] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00775146 [04/18/2023-18:33:08] [V] [TRT] Fastest Tactic: 0x4862d9a1cd4ec818 Time: 0.00398057 [04/18/2023-18:33:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:33:08] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:08] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600,40,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: /model.49/Resize (Resize) [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00729097 [04/18/2023-18:33:08] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00729097 [04/18/2023-18:33:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000000 [04/18/2023-18:33:08] [V] [TRT] *************** Autotuning format combination: Int8(3200,1600:32,40,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: /model.49/Resize (Resize) [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00331532 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0030577 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00347244 [04/18/2023-18:33:08] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.0030577 [04/18/2023-18:33:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000005 [04/18/2023-18:33:08] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:08] [V] [TRT] *************** Autotuning format combination: Int8(819200,6400,80,1) -> Int8(819200,6400,80,1) long-strided *************** [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] *************** Autotuning format combination: Int8(819200,6400,80,1) -> Int8(204800,6400,80,1) *************** [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400:4,80,1) -> Int8(204800,6400:4,80,1) long-strided *************** [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400:4,80,1) -> Int8(25600,6400:32,80,1) long-strided *************** [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400:4,80,1) -> Int8(51200,6400:4,80,1) *************** [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400:4,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] *************** Autotuning format combination: Int8(25600,6400:32,80,1) -> Int8(25600,6400:32,80,1) long-strided *************** [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:33:08] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00584375 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00596076 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00603981 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00505364 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00536178 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00680642 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00553459 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00566541 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00691962 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0074752 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00520506 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00560668 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0107713 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00516979 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00545541 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00736594 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00499184 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.00822883 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00792517 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00838476 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0109708 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00540106 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00583333 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00521796 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00565732 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.011052 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00548368 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00731886 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00792638 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0100855 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00714286 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00578779 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.005451 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00615238 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.00992457 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0109623 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00875617 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0053865 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00550242 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00687369 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.00993097 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.00956526 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0080099 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00776806 [04/18/2023-18:33:08] [V] [TRT] Fastest Tactic: 0xa40d21cb7ebb07bf Time: 0.00499184 [04/18/2023-18:33:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:33:08] [V] [TRT] *************** Autotuning format combination: Int8(25600,6400:32,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:33:08] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00579858 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00605352 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00607295 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00513306 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0053269 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00680416 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00554971 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00569125 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00694161 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0074544 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00532267 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0055884 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0107187 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00511559 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00548385 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.00735771 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00497088 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.00831137 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.00792036 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00819657 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0108875 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00540986 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00586825 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00524098 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00567086 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0110425 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00553688 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0076557 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.00792638 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.010116 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00726674 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00585399 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00549521 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00614552 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.00992091 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0111254 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.00885647 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0053699 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00547522 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00687608 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.00990263 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.00955916 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00801067 [04/18/2023-18:33:08] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.00768842 [04/18/2023-18:33:08] [V] [TRT] Fastest Tactic: 0xa40d21cb7ebb07bf Time: 0.00497088 [04/18/2023-18:33:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:33:08] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:08] [V] [TRT] *************** Autotuning format combination: Int8(819200,6400,80,1) -> Int8(204800,6400,80,1) *************** [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear + /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear + /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400:4,80,1) -> Int8(51200,6400:4,80,1) *************** [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear + /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear + /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear + /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear + /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400:4,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear + /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear + /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] *************** Autotuning format combination: Int8(25600,6400:32,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-18:33:08] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:08] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400,80,1) -> Int8(204800,6400,80,1) *************** [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] *************** Autotuning format combination: Int8(51200,6400:4,80,1) -> Int8(51200,6400:4,80,1) *************** [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] *************** Autotuning format combination: Int8(51200,6400:4,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] *************** Autotuning format combination: Int8(6400,6400:32,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:33:08] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.00751177 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00778635 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.006084 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.0079779 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00845338 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.00632447 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00668197 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.00895771 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00934657 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00627299 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.00952029 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.00609714 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.00606552 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00976609 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0131532 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00608857 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00656312 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.014001 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0143346 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00683668 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0100657 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0102609 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0135331 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.00579365 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00769901 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0132322 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0143808 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0105842 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00650597 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.0065228 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00923029 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00977524 [04/18/2023-18:33:08] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-18:33:08] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.00922686 [04/18/2023-18:33:08] [V] [TRT] Fastest Tactic: 0x5e921a04a7b0e583 Time: 0.00579365 [04/18/2023-18:33:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:33:08] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:08] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400,80,1) -> Int8(819200,6400,80,1) long-strided *************** [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400,80,1) -> Int8(204800,6400,80,1) *************** [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] *************** Autotuning format combination: Int8(51200,6400:4,80,1) -> Int8(204800,6400:4,80,1) long-strided *************** [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] *************** Autotuning format combination: Int8(51200,6400:4,80,1) -> Int8(25600,6400:32,80,1) long-strided *************** [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] *************** Autotuning format combination: Int8(51200,6400:4,80,1) -> Int8(51200,6400:4,80,1) *************** [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] *************** Autotuning format combination: Int8(51200,6400:4,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] *************** Autotuning format combination: Int8(6400,6400:32,80,1) -> Int8(25600,6400:32,80,1) long-strided *************** [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:33:08] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:08] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:08] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:09] [V] [TRT] --------------- Timing Runner: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.00754165 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00779789 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00608 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.00799619 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00844585 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.0063201 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00669091 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-18:33:09] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.00896857 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00934857 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00627021 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.00950629 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-18:33:09] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.00608495 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-18:33:09] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.00606914 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.00980815 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0131229 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00608152 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00655106 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0140172 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0143045 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:33:09] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00682971 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0100678 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.010272 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0135551 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.00580187 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00768722 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0132335 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0144219 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0105868 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00646917 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00650764 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00920114 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.00976701 [04/18/2023-18:33:09] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.00925429 [04/18/2023-18:33:09] [V] [TRT] Fastest Tactic: 0x5e921a04a7b0e583 Time: 0.00580187 [04/18/2023-18:33:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:33:09] [V] [TRT] *************** Autotuning format combination: Int8(6400,6400:32,80,1) -> Int8(6400,6400:32,80,1) *************** [04/18/2023-18:33:09] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:09] [V] [TRT] *************** Autotuning format combination: Int8(819200,6400,80,1) -> Int8(409600,6400,80,1) *************** [04/18/2023-18:33:09] [V] [TRT] --------------- Timing Runner: model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear + /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:09] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:09] [V] [TRT] --------------- Timing Runner: model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear + /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:09] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:09] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400:4,80,1) -> Int8(102400,6400:4,80,1) *************** [04/18/2023-18:33:09] [V] [TRT] --------------- Timing Runner: model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear + /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:09] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:09] [V] [TRT] --------------- Timing Runner: model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear + /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:09] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:09] [V] [TRT] --------------- Timing Runner: model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear + /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:09] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:09] [V] [TRT] --------------- Timing Runner: model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear + /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:09] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:09] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400:4,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:33:09] [V] [TRT] --------------- Timing Runner: model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear + /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:09] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:09] [V] [TRT] --------------- Timing Runner: model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear + /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:09] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:09] [V] [TRT] *************** Autotuning format combination: Int8(25600,6400:32,80,1) -> Int8(12800,6400:32,80,1) *************** [04/18/2023-18:33:09] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:09] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Float(409600,1600,40,1) long-strided *************** [04/18/2023-18:33:09] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:09] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:09] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:09] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:09] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:09] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 Tactic: 0x127de12a1f1a4809 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x127de12a1f1a4809 Time: 0.0308663 [04/18/2023-18:33:09] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.0302702 [04/18/2023-18:33:09] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.0228212 [04/18/2023-18:33:09] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.0243093 [04/18/2023-18:33:09] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-18:33:09] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0230034 [04/18/2023-18:33:09] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.0305353 [04/18/2023-18:33:09] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0207451 [04/18/2023-18:33:09] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 Tactic: 0x1b0534177b414e71 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x1b0534177b414e71 Time: 0.0219128 [04/18/2023-18:33:09] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.0215562 [04/18/2023-18:33:09] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-18:33:09] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.0256564 [04/18/2023-18:33:09] [V] [TRT] Fastest Tactic: 0x4d9d0d03129bceb1 Time: 0.0207451 [04/18/2023-18:33:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4d9d0d03129bceb1 [04/18/2023-18:33:09] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Float(204800,1600,40,1) *************** [04/18/2023-18:33:09] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:09] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:09] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:09] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:09] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:09] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 Tactic: 0x127de12a1f1a4809 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x127de12a1f1a4809 Time: 0.0306112 [04/18/2023-18:33:09] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.0300791 [04/18/2023-18:33:09] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.022607 [04/18/2023-18:33:09] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.0241364 [04/18/2023-18:33:09] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-18:33:09] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0227853 [04/18/2023-18:33:09] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.0303561 [04/18/2023-18:33:09] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0205427 [04/18/2023-18:33:09] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 Tactic: 0x1b0534177b414e71 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x1b0534177b414e71 Time: 0.0216026 [04/18/2023-18:33:09] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.0213995 [04/18/2023-18:33:09] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-18:33:09] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.0255101 [04/18/2023-18:33:09] [V] [TRT] Fastest Tactic: 0x4d9d0d03129bceb1 Time: 0.0205427 [04/18/2023-18:33:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4d9d0d03129bceb1 [04/18/2023-18:33:09] [V] [TRT] *************** Autotuning format combination: Int8(12800,6400:32,80,1) -> Float(409600,1600,40,1) long-strided *************** [04/18/2023-18:33:09] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:09] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:09] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:09] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x2bcbba39f608bf10 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x2bcbba39f608bf10 Time: 0.0116494 [04/18/2023-18:33:09] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x85c1a5f7f239cf84 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x85c1a5f7f239cf84 Time: 0.0100605 [04/18/2023-18:33:09] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0xac914b235d066808 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0xac914b235d066808 Time: 0.0158979 [04/18/2023-18:33:09] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0xa8b56a226b057463 [04/18/2023-18:33:09] [V] [TRT] Tactic: 0xa8b56a226b057463 Time: 0.00995413 [04/18/2023-18:33:09] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x64x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x23b890da05937b9e [04/18/2023-18:33:09] [V] [TRT] Tactic: 0x23b890da05937b9e Time: 0.0111226 [04/18/2023-18:33:09] [V] [TRT] Fastest Tactic: 0xa8b56a226b057463 Time: 0.00995413 [04/18/2023-18:33:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa8b56a226b057463 [04/18/2023-18:33:09] [V] [TRT] *************** Autotuning format combination: Int8(12800,6400:32,80,1) -> Float(12800,1600:32,40,1) long-strided *************** [04/18/2023-18:33:19] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskJitConv) [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3d41ef6de22d9b6 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0xd3d41ef6de22d9b6 Time: 0.0137687 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0230087 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00794743 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.00935972 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xf8d4389f60adfa3c [04/18/2023-18:33:19] [V] [TRT] Tactic: 0xf8d4389f60adfa3c Time: 0.0227775 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00888578 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x2f34f689bfca5071 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x2f34f689bfca5071 Time: 0.00773053 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x554e2e252e28b3fd [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x554e2e252e28b3fd Time: 0.0189989 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0191697 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x4749124f62d8bd23 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x4749124f62d8bd23 Time: 0.00867818 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3f592fae61c7986 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0xd3f592fae61c7986 Time: 0.0085604 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0139021 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00917714 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xbb88763c3b0e94d4 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0xbb88763c3b0e94d4 Time: 0.00785299 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xea88b51105501f96 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0xea88b51105501f96 Time: 0.013339 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd30e9f770878c3fd [04/18/2023-18:33:19] [V] [TRT] Tactic: 0xd30e9f770878c3fd Time: 0.00897857 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x53554c607d072468 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x53554c607d072468 Time: 0.00941029 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00806527 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.0097091 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00878655 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.013312 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x705baf38e41eee0b [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x705baf38e41eee0b Time: 0.00881049 [04/18/2023-18:33:19] [V] [TRT] Fastest Tactic: 0x2f34f689bfca5071 Time: 0.00773053 [04/18/2023-18:33:19] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:19] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:19] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x45f7566cdb2b10fb [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x45f7566cdb2b10fb Time: 0.0113878 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-18:33:19] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.0141914 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xea2b7420057a01c1 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0xea2b7420057a01c1 Time: 0.0223001 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.0113741 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x2d8ab2aa0639fda9 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x2d8ab2aa0639fda9 Time: 0.0105231 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd14bd6d95fefd45e [04/18/2023-18:33:19] [V] [TRT] Tactic: 0xd14bd6d95fefd45e Time: 0.0113519 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.0116811 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.0117602 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.011865 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x0e07dc8353bf7e9f [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x0e07dc8353bf7e9f Time: 0.0162245 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x55edef142e02adaa [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x55edef142e02adaa Time: 0.0156873 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.0221068 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.0164033 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x0edd5d0285e564d4 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x0edd5d0285e564d4 Time: 0.0116167 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xb936321f82fd390c [04/18/2023-18:33:19] [V] [TRT] Tactic: 0xb936321f82fd390c Time: 0.0106599 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.0112422 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.0114803 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xad886d4d69834922 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0xad886d4d69834922 Time: 0.0113959 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0258956 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x47b1629a4bff4800 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x47b1629a4bff4800 Time: 0.0254956 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.0110404 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.0168899 [04/18/2023-18:33:19] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-18:33:19] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.0179577 [04/18/2023-18:33:19] [V] [TRT] Fastest Tactic: 0x2d8ab2aa0639fda9 Time: 0.0105231 [04/18/2023-18:33:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0x2f34f689bfca5071 [04/18/2023-18:33:19] [V] [TRT] *************** Autotuning format combination: Int8(12800,6400:32,80,1) -> Half(12800,1600:32,40,1) long-strided *************** [04/18/2023-18:33:29] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskJitConv) [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3d41ef6de22d9b6 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0xd3d41ef6de22d9b6 Time: 0.0116223 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0186646 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00740868 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.00833473 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xf8d4389f60adfa3c [04/18/2023-18:33:29] [V] [TRT] Tactic: 0xf8d4389f60adfa3c Time: 0.0183714 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00835606 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x2f34f689bfca5071 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x2f34f689bfca5071 Time: 0.00714079 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x554e2e252e28b3fd [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x554e2e252e28b3fd Time: 0.0172744 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0175299 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x4749124f62d8bd23 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x4749124f62d8bd23 Time: 0.00824 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3f592fae61c7986 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0xd3f592fae61c7986 Time: 0.00777841 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0118604 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00822756 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xbb88763c3b0e94d4 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0xbb88763c3b0e94d4 Time: 0.00688087 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xea88b51105501f96 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0xea88b51105501f96 Time: 0.0114184 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd30e9f770878c3fd [04/18/2023-18:33:29] [V] [TRT] Tactic: 0xd30e9f770878c3fd Time: 0.00820622 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x53554c607d072468 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x53554c607d072468 Time: 0.00857412 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00733668 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.00887852 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00793552 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.0114163 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x705baf38e41eee0b [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x705baf38e41eee0b Time: 0.00806146 [04/18/2023-18:33:29] [V] [TRT] Fastest Tactic: 0xbb88763c3b0e94d4 Time: 0.00688087 [04/18/2023-18:33:29] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:29] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:29] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0xbb88763c3b0e94d4 [04/18/2023-18:33:29] [V] [TRT] *************** Autotuning format combination: Int8(12800,6400:32,80,1) -> Float(204800,1600,40,1) *************** [04/18/2023-18:33:29] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:29] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:29] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x2bcbba39f608bf10 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x2bcbba39f608bf10 Time: 0.012997 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x85c1a5f7f239cf84 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x85c1a5f7f239cf84 Time: 0.0112302 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0xac914b235d066808 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0xac914b235d066808 Time: 0.0178255 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0xa8b56a226b057463 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0xa8b56a226b057463 Time: 0.0110977 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x64x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x23b890da05937b9e [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x23b890da05937b9e Time: 0.0123364 [04/18/2023-18:33:29] [V] [TRT] Fastest Tactic: 0xa8b56a226b057463 Time: 0.0110977 [04/18/2023-18:33:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa8b56a226b057463 [04/18/2023-18:33:29] [V] [TRT] *************** Autotuning format combination: Int8(12800,6400:32,80,1) -> Float(6400,1600:32,40,1) *************** [04/18/2023-18:33:29] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskJitConv) [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3d41ef6de22d9b6 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0xd3d41ef6de22d9b6 Time: 0.0136062 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0230433 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00798451 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.00933971 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xf8d4389f60adfa3c [04/18/2023-18:33:29] [V] [TRT] Tactic: 0xf8d4389f60adfa3c Time: 0.0227755 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00888847 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x2f34f689bfca5071 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x2f34f689bfca5071 Time: 0.00776782 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x554e2e252e28b3fd [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x554e2e252e28b3fd Time: 0.0189103 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0191657 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x4749124f62d8bd23 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x4749124f62d8bd23 Time: 0.00872417 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3f592fae61c7986 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0xd3f592fae61c7986 Time: 0.0086002 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0138996 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00916771 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xbb88763c3b0e94d4 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0xbb88763c3b0e94d4 Time: 0.00785829 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xea88b51105501f96 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0xea88b51105501f96 Time: 0.0133199 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd30e9f770878c3fd [04/18/2023-18:33:29] [V] [TRT] Tactic: 0xd30e9f770878c3fd Time: 0.00902 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x53554c607d072468 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x53554c607d072468 Time: 0.00942943 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00810108 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.00967985 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00881237 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.0133033 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x705baf38e41eee0b [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x705baf38e41eee0b Time: 0.0087758 [04/18/2023-18:33:29] [V] [TRT] Fastest Tactic: 0x2f34f689bfca5071 Time: 0.00776782 [04/18/2023-18:33:29] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:29] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:29] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x45f7566cdb2b10fb [04/18/2023-18:33:29] [V] [TRT] Tactic: 0x45f7566cdb2b10fb Time: 0.0112949 [04/18/2023-18:33:29] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.0141897 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xea2b7420057a01c1 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xea2b7420057a01c1 Time: 0.0216921 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.0112844 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x2d8ab2aa0639fda9 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x2d8ab2aa0639fda9 Time: 0.0105211 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd14bd6d95fefd45e [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xd14bd6d95fefd45e Time: 0.0112239 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.0116413 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.0117932 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.0118491 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x0e07dc8353bf7e9f [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x0e07dc8353bf7e9f Time: 0.0162052 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x55edef142e02adaa [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x55edef142e02adaa Time: 0.0155941 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.0220454 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.0160874 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x0edd5d0285e564d4 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x0edd5d0285e564d4 Time: 0.0115597 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xb936321f82fd390c [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xb936321f82fd390c Time: 0.0106269 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.0111532 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.0114504 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xad886d4d69834922 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xad886d4d69834922 Time: 0.0113459 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0258423 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x47b1629a4bff4800 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x47b1629a4bff4800 Time: 0.025405 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.0110695 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.0168879 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.0176279 [04/18/2023-18:33:30] [V] [TRT] Fastest Tactic: 0x2d8ab2aa0639fda9 Time: 0.0105211 [04/18/2023-18:33:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0x2f34f689bfca5071 [04/18/2023-18:33:30] [V] [TRT] *************** Autotuning format combination: Int8(12800,6400:32,80,1) -> Half(6400,1600:32,40,1) *************** [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskJitConv) [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3d41ef6de22d9b6 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xd3d41ef6de22d9b6 Time: 0.0116181 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.018664 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00742034 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.0083167 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xf8d4389f60adfa3c [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xf8d4389f60adfa3c Time: 0.0183269 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00837664 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x2f34f689bfca5071 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x2f34f689bfca5071 Time: 0.00715543 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x554e2e252e28b3fd [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x554e2e252e28b3fd Time: 0.0173084 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0175243 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x4749124f62d8bd23 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x4749124f62d8bd23 Time: 0.00818768 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3f592fae61c7986 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xd3f592fae61c7986 Time: 0.00775314 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0118769 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00822171 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xbb88763c3b0e94d4 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xbb88763c3b0e94d4 Time: 0.00687586 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xea88b51105501f96 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xea88b51105501f96 Time: 0.0114113 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd30e9f770878c3fd [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xd30e9f770878c3fd Time: 0.00822121 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x53554c607d072468 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x53554c607d072468 Time: 0.00857143 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.0073488 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.00887099 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00808127 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.011404 [04/18/2023-18:33:30] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x705baf38e41eee0b [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x705baf38e41eee0b Time: 0.00808559 [04/18/2023-18:33:30] [V] [TRT] Fastest Tactic: 0xbb88763c3b0e94d4 Time: 0.00687586 [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0xbb88763c3b0e94d4 [04/18/2023-18:33:30] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:30] [V] [TRT] *************** Autotuning format combination: Int8(409600,6400,80,1) -> Int8(819200,6400,80,1) *************** [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(204800,6400:4,80,1) *************** [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] *************** Autotuning format combination: Int8(102400,6400:4,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] *************** Autotuning format combination: Int8(12800,6400:32,80,1) -> Int8(25600,6400:32,80,1) *************** [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:33:30] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.0192046 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0205845 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0177818 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.0185377 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.019552 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.0135888 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.0146053 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.0147982 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0155826 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.013957 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0140659 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.0137222 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.0137272 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0143031 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0199903 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0212532 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0148005 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0212526 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0215798 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0163972 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.01472 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0155474 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0204069 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.0164937 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.022479 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0203674 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0215896 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0155991 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0150949 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.0145408 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0211187 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0144859 [04/18/2023-18:33:30] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0138406 [04/18/2023-18:33:30] [V] [TRT] Fastest Tactic: 0xa085d13614221ec4 Time: 0.0135888 [04/18/2023-18:33:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa085d13614221ec4 [04/18/2023-18:33:30] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:30] [V] [TRT] *************** Autotuning format combination: Int8(204800,6400:4,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv (CudaDepthwiseConvolution) [04/18/2023-18:33:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv (CaskFlattenConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv (CaskConvolution) [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 0xc25454de2efcccdc [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xc25454de2efcccdc Time: 0.027651 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: 0xff6944b17d5b2e32 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xff6944b17d5b2e32 Time: 0.0223353 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.0218632 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.0224999 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.0255261 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0294327 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.0218253 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0285842 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 0x1db6e8cf1382fbe0 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x1db6e8cf1382fbe0 Time: 0.0225933 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: 0xa4ae2d82115c3e83 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xa4ae2d82115c3e83 Time: 0.0241646 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.0224862 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.0252846 [04/18/2023-18:33:30] [V] [TRT] Fastest Tactic: 0x2cf4271504d30e29 Time: 0.0218253 [04/18/2023-18:33:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x2cf4271504d30e29 [04/18/2023-18:33:30] [V] [TRT] *************** Autotuning format combination: Int8(25600,6400:32,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv (CaskFlattenConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv (CaskConvolution) [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x733ba2a91a48d431 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x733ba2a91a48d431 Time: 0.0207249 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0xf04572b287451f42 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xf04572b287451f42 Time: 0.0266918 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x5e4f6d7c83746fd6 Time: 0.026112 [04/18/2023-18:33:30] [V] [TRT] Fastest Tactic: 0x733ba2a91a48d431 Time: 0.0207249 [04/18/2023-18:33:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x733ba2a91a48d431 [04/18/2023-18:33:30] [V] [TRT] *************** Autotuning format combination: Int8(25600,6400:32,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv (CaskFlattenConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv (CaskConvolution) [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa71946688cad8664 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xa71946688cad8664 Time: 0.0184977 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x1e55f8b415964e81 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x1e55f8b415964e81 Time: 0.0229636 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.0265265 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9003f5f7ff9b1aec [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x9003f5f7ff9b1aec Time: 0.0225711 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9ec201b34455146e [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x9ec201b34455146e Time: 0.0198017 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x91930a570b557437 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x91930a570b557437 Time: 0.0225019 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdf7e1bd6a496d667 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xdf7e1bd6a496d667 Time: 0.0231784 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6d377e4222886190 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x6d377e4222886190 Time: 0.0191463 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x271b998fe31732ef [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x271b998fe31732ef Time: 0.0223465 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.023072 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x960e9baa2a6cad5b [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x960e9baa2a6cad5b Time: 0.0183029 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.0213329 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x84942841d92b0552 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x84942841d92b0552 Time: 0.023631 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xbeb5d91e1874a437 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xbeb5d91e1874a437 Time: 0.0221303 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcd229658c16b33cd [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xcd229658c16b33cd Time: 0.0230295 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.0231726 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.0221969 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x33a5c6dd086942c1 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x33a5c6dd086942c1 Time: 0.0208307 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7720f198395e7d3d [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x7720f198395e7d3d Time: 0.0216327 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.0231497 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.0227161 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x60b880e28fee7a0c [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x60b880e28fee7a0c Time: 0.0231713 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcf64a2ae51bf6b36 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xcf64a2ae51bf6b36 Time: 0.0200126 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x844ea9c00f711f19 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x844ea9c00f711f19 Time: 0.0219984 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x65fbe45b4cb1d8a5 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x65fbe45b4cb1d8a5 Time: 0.0196183 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.0226488 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.0217071 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5bd8221bd57baf93 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x5bd8221bd57baf93 Time: 0.0198029 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0229251 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.0187223 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.0237949 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6e9c17a33c93d9b0 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x6e9c17a33c93d9b0 Time: 0.0217025 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.0237721 [04/18/2023-18:33:30] [V] [TRT] Fastest Tactic: 0x960e9baa2a6cad5b Time: 0.0183029 [04/18/2023-18:33:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x960e9baa2a6cad5b [04/18/2023-18:33:30] [V] [TRT] *************** Autotuning format combination: Int8(25600,6400:32,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv (CaskFlattenConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv (CaskConvolution) [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5812ced7874b44d1 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x5812ced7874b44d1 Time: 0.0136831 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x43e3804f158e597d [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x43e3804f158e597d Time: 0.012069 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7524377e24bc511f [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x7524377e24bc511f Time: 0.0146839 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x264d83735b1cba13 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x264d83735b1cba13 Time: 0.011252 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3e116db8858d0d41 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x3e116db8858d0d41 Time: 0.0118368 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x758f8b2079a95b2e [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x758f8b2079a95b2e Time: 0.010959 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7de8ad674a85e82a [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x7de8ad674a85e82a Time: 0.012443 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x8f07802f58d278c0 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x8f07802f58d278c0 Time: 0.00992396 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x1cfa820c55616892 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x1cfa820c55616892 Time: 0.0106687 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xccdb99df0646c7b3 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xccdb99df0646c7b3 Time: 0.014016 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcf392eca056b8d88 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xcf392eca056b8d88 Time: 0.00981882 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x4f8662a723b489e1 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x4f8662a723b489e1 Time: 0.0132073 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x8e1dd2962c589dd4 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x8e1dd2962c589dd4 Time: 0.00999131 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xaba07efc49c11a6c [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xaba07efc49c11a6c Time: 0.00960518 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xd7985d83133bcf37 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xd7985d83133bcf37 Time: 0.014992 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xb34706d47a62a016 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xb34706d47a62a016 Time: 0.0137529 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x8486adb55ae0ca6c [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x8486adb55ae0ca6c Time: 0.0102194 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x86d1488f426124e1 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x86d1488f426124e1 Time: 0.0128865 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcba01f45d37a76a0 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xcba01f45d37a76a0 Time: 0.011928 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x62a338704beec449 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x62a338704beec449 Time: 0.0096579 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x68f52f0a3f1c5b56 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x68f52f0a3f1c5b56 Time: 0.0113582 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdb3ae212a7704d44 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xdb3ae212a7704d44 Time: 0.0134433 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x4e7f02f91ddf4673 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x4e7f02f91ddf4673 Time: 0.00985722 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xaceaca2c82ab40f3 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xaceaca2c82ab40f3 Time: 0.0148485 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xaa30815cbd0f74b7 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xaa30815cbd0f74b7 Time: 0.00926086 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6c336d1b7c64ffa3 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x6c336d1b7c64ffa3 Time: 0.0109025 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb7a90e7097d64877 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0xb7a90e7097d64877 Time: 0.0110871 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x682fae8be946411d [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x682fae8be946411d Time: 0.0114483 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x70ffb5fe2e1321e3 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x70ffb5fe2e1321e3 Time: 0.0107915 [04/18/2023-18:33:30] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x27fb8661fea664b3 [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x27fb8661fea664b3 Time: 0.0104392 [04/18/2023-18:33:30] [V] [TRT] Fastest Tactic: 0xaa30815cbd0f74b7 Time: 0.00926086 [04/18/2023-18:33:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xaa30815cbd0f74b7 [04/18/2023-18:33:30] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:30] [V] [TRT] *************** Autotuning format combination: Int8(409600,1600,40,1) -> Int8(409600,1600,40,1) long-strided *************** [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] *************** Autotuning format combination: Int8(409600,1600,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(102400,1600:4,40,1) long-strided *************** [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(12800,1600:32,40,1) long-strided *************** [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Int8(12800,1600:32,40,1) long-strided *************** [04/18/2023-18:33:30] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:33:30] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:30] [V] [TRT] *************** Autotuning format combination: Int8(409600,1600,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear + /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear + /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear + /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:33:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear + /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:33:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear + /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear + /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear + /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear + /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:33:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:33:30] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:33:30] [V] [TRT] =============== Computing costs for [04/18/2023-18:33:30] [V] [TRT] *************** Autotuning format combination: Float(1632000,6400,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:33:30] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-18:33:30] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0217855 [04/18/2023-18:33:31] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0229656 [04/18/2023-18:33:31] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0225567 [04/18/2023-18:33:31] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0227605 [04/18/2023-18:33:31] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0225646 [04/18/2023-18:33:31] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0218684 [04/18/2023-18:33:31] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.023984 [04/18/2023-18:33:31] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0226051 [04/18/2023-18:33:32] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0220519 [04/18/2023-18:33:32] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0216163 [04/18/2023-18:33:32] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0224444 [04/18/2023-18:33:32] [V] [TRT] Fastest Tactic: 0x0000000000000009 Time: 0.0216163 [04/18/2023-18:33:32] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWise) [04/18/2023-18:33:32] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:33:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000009 [04/18/2023-18:33:32] [V] [TRT] *************** Autotuning format combination: Float(1632000,6400,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-18:33:32] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-18:33:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0183189 [04/18/2023-18:33:32] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0174745 [04/18/2023-18:33:32] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0159624 [04/18/2023-18:33:33] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.017181 [04/18/2023-18:33:33] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0163657 [04/18/2023-18:33:33] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0164434 [04/18/2023-18:33:33] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0183994 [04/18/2023-18:33:33] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0173943 [04/18/2023-18:33:33] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0160401 [04/18/2023-18:33:34] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0159573 [04/18/2023-18:33:34] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0181394 [04/18/2023-18:33:34] [V] [TRT] Fastest Tactic: 0x0000000000000009 Time: 0.0159573 [04/18/2023-18:33:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000009 [04/18/2023-18:33:34] [V] [TRT] *************** Autotuning format combination: Float(1632000,1,20400,255) -> Float(1632000,1,20400,255) *************** [04/18/2023-18:33:34] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-18:33:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0223798 [04/18/2023-18:33:34] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0222563 [04/18/2023-18:33:34] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0222629 [04/18/2023-18:33:34] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0230315 [04/18/2023-18:33:34] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0232803 [04/18/2023-18:33:34] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0224444 [04/18/2023-18:33:34] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0242347 [04/18/2023-18:33:34] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0227546 [04/18/2023-18:33:34] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0225273 [04/18/2023-18:33:34] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0227135 [04/18/2023-18:33:34] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0234083 [04/18/2023-18:33:34] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0222563 [04/18/2023-18:33:34] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWise) [04/18/2023-18:33:34] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:33:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000001 [04/18/2023-18:33:34] [V] [TRT] *************** Autotuning format combination: Float(409600,1:4,5120,64) -> Float(409600,1:4,5120,64) *************** [04/18/2023-18:33:34] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-18:33:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0222981 [04/18/2023-18:33:34] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0229858 [04/18/2023-18:33:34] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0225463 [04/18/2023-18:33:35] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.023185 [04/18/2023-18:33:35] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0224679 [04/18/2023-18:33:35] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0227213 [04/18/2023-18:33:35] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0227481 [04/18/2023-18:33:35] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0235494 [04/18/2023-18:33:35] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0231765 [04/18/2023-18:33:36] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0234266 [04/18/2023-18:33:36] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0227618 [04/18/2023-18:33:36] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0233084 [04/18/2023-18:33:36] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0225933 [04/18/2023-18:33:36] [V] [TRT] Tactic: 0x000000000000000d Time: 0.023901 [04/18/2023-18:33:37] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0233162 [04/18/2023-18:33:37] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0234684 [04/18/2023-18:33:37] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.023505 [04/18/2023-18:33:37] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0227193 [04/18/2023-18:33:37] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0225966 [04/18/2023-18:33:38] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0228088 [04/18/2023-18:33:38] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0229198 [04/18/2023-18:33:38] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0229669 [04/18/2023-18:33:38] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0235729 [04/18/2023-18:33:38] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0246248 [04/18/2023-18:33:38] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0227396 [04/18/2023-18:33:39] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0241128 [04/18/2023-18:33:39] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0229976 [04/18/2023-18:33:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0222981 [04/18/2023-18:33:39] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWise) [04/18/2023-18:33:39] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:33:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 [04/18/2023-18:33:39] [V] [TRT] *************** Autotuning format combination: Float(51200,6400:32,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-18:33:39] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-18:33:39] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0223954 [04/18/2023-18:33:39] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0227056 [04/18/2023-18:33:39] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0235918 [04/18/2023-18:33:39] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0231758 [04/18/2023-18:33:40] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0224607 [04/18/2023-18:33:40] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.0223954 [04/18/2023-18:33:40] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWise) [04/18/2023-18:33:40] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:33:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-18:33:40] [V] [TRT] *************** Autotuning format combination: Float(51200,6400:32,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-18:33:40] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-18:33:40] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0165288 [04/18/2023-18:33:40] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0170494 [04/18/2023-18:33:40] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0180491 [04/18/2023-18:33:40] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.018272 [04/18/2023-18:33:40] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0163972 [04/18/2023-18:33:41] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0173516 [04/18/2023-18:33:41] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0178326 [04/18/2023-18:33:41] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0167533 [04/18/2023-18:33:41] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0167416 [04/18/2023-18:33:41] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0178703 [04/18/2023-18:33:41] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.0163972 [04/18/2023-18:33:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-18:33:41] [V] [TRT] *************** Autotuning format combination: Float(1:4,6400,80,1) -> Float(1:4,6400,80,1) *************** [04/18/2023-18:33:41] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-18:33:41] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0800183 [04/18/2023-18:33:41] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0806766 [04/18/2023-18:33:41] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0819063 [04/18/2023-18:33:41] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.0800183 [04/18/2023-18:33:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:33:41] [V] [TRT] *************** Autotuning format combination: Half(1632000,6400,80,1) -> Float(1632000,6400,80,1) *************** [04/18/2023-18:33:41] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-18:33:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0187669 [04/18/2023-18:33:42] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.018004 [04/18/2023-18:33:42] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0175746 [04/18/2023-18:33:42] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0185097 [04/18/2023-18:33:42] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0185469 [04/18/2023-18:33:42] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0192303 [04/18/2023-18:33:42] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.020036 [04/18/2023-18:33:43] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0189246 [04/18/2023-18:33:43] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0190806 [04/18/2023-18:33:43] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0184091 [04/18/2023-18:33:43] [V] [TRT] Tactic: 0x000000000000001c Time: 0.019224 [04/18/2023-18:33:43] [V] [TRT] Fastest Tactic: 0x0000000000000002 Time: 0.0175746 [04/18/2023-18:33:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000002 [04/18/2023-18:33:43] [V] [TRT] *************** Autotuning format combination: Half(1632000,6400,80,1) -> Half(1632000,6400,80,1) *************** [04/18/2023-18:33:43] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-18:33:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0168 [04/18/2023-18:33:43] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0136478 [04/18/2023-18:33:44] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0106916 [04/18/2023-18:33:44] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0116568 [04/18/2023-18:33:44] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00990842 [04/18/2023-18:33:44] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.009328 [04/18/2023-18:33:44] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0116473 [04/18/2023-18:33:44] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00916686 [04/18/2023-18:33:45] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00850259 [04/18/2023-18:33:45] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00826819 [04/18/2023-18:33:45] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0169829 [04/18/2023-18:33:45] [V] [TRT] Fastest Tactic: 0x0000000000000009 Time: 0.00826819 [04/18/2023-18:33:45] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWise) [04/18/2023-18:33:45] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:33:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000009 [04/18/2023-18:33:45] [V] [TRT] *************** Autotuning format combination: Half(819200,6400:2,80,1) -> Half(819200,6400:2,80,1) *************** [04/18/2023-18:33:45] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-18:33:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0159609 [04/18/2023-18:33:45] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.012768 [04/18/2023-18:33:45] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0121794 [04/18/2023-18:33:46] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0119973 [04/18/2023-18:33:46] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0116512 [04/18/2023-18:33:46] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0141274 [04/18/2023-18:33:46] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0127718 [04/18/2023-18:33:46] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0121604 [04/18/2023-18:33:46] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0144937 [04/18/2023-18:33:47] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0177712 [04/18/2023-18:33:47] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0227115 [04/18/2023-18:33:47] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0175868 [04/18/2023-18:33:47] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0143913 [04/18/2023-18:33:47] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0140605 [04/18/2023-18:33:48] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0121166 [04/18/2023-18:33:48] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0105776 [04/18/2023-18:33:48] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0140339 [04/18/2023-18:33:48] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0101879 [04/18/2023-18:33:48] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00967771 [04/18/2023-18:33:48] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00899971 [04/18/2023-18:33:49] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0147429 [04/18/2023-18:33:49] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0229878 [04/18/2023-18:33:49] [V] [TRT] Fastest Tactic: 0x0000000000000013 Time: 0.00899971 [04/18/2023-18:33:49] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWise) [04/18/2023-18:33:49] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:33:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000013 [04/18/2023-18:33:49] [V] [TRT] *************** Autotuning format combination: Half(204800,1:8,2560,32) -> Half(204800,1:8,2560,32) *************** [04/18/2023-18:33:49] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-18:33:49] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0137521 [04/18/2023-18:33:49] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0139703 [04/18/2023-18:33:49] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0155182 [04/18/2023-18:33:49] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0145691 [04/18/2023-18:33:50] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0155579 [04/18/2023-18:33:50] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0144379 [04/18/2023-18:33:50] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0144059 [04/18/2023-18:33:50] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0150107 [04/18/2023-18:33:50] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0133074 [04/18/2023-18:33:51] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0129547 [04/18/2023-18:33:51] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0115045 [04/18/2023-18:33:51] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0114011 [04/18/2023-18:33:51] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0149513 [04/18/2023-18:33:51] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0125451 [04/18/2023-18:33:52] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0148041 [04/18/2023-18:33:52] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0147067 [04/18/2023-18:33:52] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0174867 [04/18/2023-18:33:52] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0152032 [04/18/2023-18:33:52] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0148759 [04/18/2023-18:33:53] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0134462 [04/18/2023-18:33:53] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0137986 [04/18/2023-18:33:53] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0122667 [04/18/2023-18:33:53] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0126617 [04/18/2023-18:33:53] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0140355 [04/18/2023-18:33:53] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0201931 [04/18/2023-18:33:54] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.017185 [04/18/2023-18:33:54] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0143502 [04/18/2023-18:33:54] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0137338 [04/18/2023-18:33:54] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0140364 [04/18/2023-18:33:54] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0115608 [04/18/2023-18:33:54] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0131882 [04/18/2023-18:33:55] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0194926 [04/18/2023-18:33:55] [V] [TRT] Fastest Tactic: 0x000000000000000b Time: 0.0114011 [04/18/2023-18:33:55] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWise) [04/18/2023-18:33:55] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:33:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000000b [04/18/2023-18:33:55] [V] [TRT] *************** Autotuning format combination: Half(102400,1:16,1280,16) -> Half(102400,1:16,1280,16) *************** [04/18/2023-18:33:55] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-18:33:55] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0147945 [04/18/2023-18:33:55] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0152576 [04/18/2023-18:33:55] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0143095 [04/18/2023-18:33:55] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0162316 [04/18/2023-18:33:56] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0135938 [04/18/2023-18:33:56] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0133515 [04/18/2023-18:33:56] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0204857 [04/18/2023-18:33:56] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0148384 [04/18/2023-18:33:56] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0134782 [04/18/2023-18:33:57] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0129891 [04/18/2023-18:33:57] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0113505 [04/18/2023-18:33:57] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0119074 [04/18/2023-18:33:57] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0127032 [04/18/2023-18:33:57] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0152311 [04/18/2023-18:33:58] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0135659 [04/18/2023-18:33:58] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0124149 [04/18/2023-18:33:58] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0122537 [04/18/2023-18:33:58] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0140634 [04/18/2023-18:33:58] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0144677 [04/18/2023-18:33:58] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0113663 [04/18/2023-18:33:59] [V] [TRT] Tactic: 0x000000000000001f Time: 0.013194 [04/18/2023-18:33:59] [V] [TRT] Fastest Tactic: 0x0000000000000014 Time: 0.0113505 [04/18/2023-18:33:59] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWise) [04/18/2023-18:33:59] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:33:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000014 [04/18/2023-18:33:59] [V] [TRT] *************** Autotuning format combination: Half(51200,6400:32,80,1) -> Float(51200,6400:32,80,1) *************** [04/18/2023-18:33:59] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-18:33:59] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0185634 [04/18/2023-18:33:59] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.019968 [04/18/2023-18:33:59] [V] [TRT] Tactic: 0x000000000000001a Time: 0.019828 [04/18/2023-18:33:59] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0189051 [04/18/2023-18:33:59] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0184394 [04/18/2023-18:33:59] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.0184394 [04/18/2023-18:33:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-18:33:59] [V] [TRT] *************** Autotuning format combination: Half(51200,6400:32,80,1) -> Half(51200,6400:32,80,1) *************** [04/18/2023-18:33:59] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-18:34:00] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0141261 [04/18/2023-18:34:00] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0151447 [04/18/2023-18:34:00] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0120545 [04/18/2023-18:34:00] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0121627 [04/18/2023-18:34:00] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.011989 [04/18/2023-18:34:01] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0115675 [04/18/2023-18:34:01] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0120179 [04/18/2023-18:34:01] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0108549 [04/18/2023-18:34:01] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0149797 [04/18/2023-18:34:01] [V] [TRT] Tactic: 0x000000000000001f Time: 0.011603 [04/18/2023-18:34:01] [V] [TRT] Fastest Tactic: 0x000000000000001b Time: 0.0108549 [04/18/2023-18:34:01] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWise) [04/18/2023-18:34:01] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:34:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001b [04/18/2023-18:34:01] [V] [TRT] *************** Autotuning format combination: Half(1:8,6400,80,1) -> Half(1:8,6400,80,1) *************** [04/18/2023-18:34:01] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-18:34:01] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0966217 [04/18/2023-18:34:01] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0833829 [04/18/2023-18:34:01] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0846789 [04/18/2023-18:34:01] [V] [TRT] Tactic: 0x000000000000001f Time: 0.130414 [04/18/2023-18:34:01] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.0833829 [04/18/2023-18:34:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [04/18/2023-18:34:01] [V] [TRT] *************** Autotuning format combination: Half(1632000:32,6400,80,1) -> Half(1632000:32,6400,80,1) *************** [04/18/2023-18:34:01] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid) (PointWiseV2) [04/18/2023-18:34:01] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.452169 [04/18/2023-18:34:02] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.44544 [04/18/2023-18:34:02] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.444709 [04/18/2023-18:34:02] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.457289 [04/18/2023-18:34:02] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.32517 [04/18/2023-18:34:02] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.327534 [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x000000000000001a Time: 0.338213 [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x000000000000001b Time: 0.332507 [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x000000000000001e Time: 0.38912 [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x000000000000001f Time: 0.330898 [04/18/2023-18:34:03] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.32517 [04/18/2023-18:34:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-18:34:03] [V] [TRT] =============== Computing costs for [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Float(1632000,6400,80,1) -> Float(1632000,544000,6800,85,1) *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Reshape + /model.77/Transpose (Shuffle) [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0298368 [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0489539 [04/18/2023-18:34:03] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0298368 [04/18/2023-18:34:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Float(1632000,1,20400,255) -> Float(1632000,544000,1,6800,80) *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Reshape + /model.77/Transpose (Shuffle) [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0908434 [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0494446 [04/18/2023-18:34:03] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0494446 [04/18/2023-18:34:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Float(409600,1:4,5120,64) -> Float(408000,136000,1:4,1700,20) *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Reshape + /model.77/Transpose (Shuffle) [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0907703 [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0589044 [04/18/2023-18:34:03] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0589044 [04/18/2023-18:34:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Float(51200,6400:32,80,1) -> Float(61200,20400,6800:32,85,1) *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Reshape + /model.77/Transpose (Shuffle) [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.125513 [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0593432 [04/18/2023-18:34:03] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0593432 [04/18/2023-18:34:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Half(1632000,6400,80,1) -> Half(1632000,544000,6800,85,1) *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Reshape + /model.77/Transpose (Shuffle) [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0257989 [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0642194 [04/18/2023-18:34:03] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0257989 [04/18/2023-18:34:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Half(819200,6400:2,80,1) -> Half(816000,272000,6800:2,85,1) *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Reshape + /model.77/Transpose (Shuffle) [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0279893 [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0917509 [04/18/2023-18:34:03] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0279893 [04/18/2023-18:34:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Half(409600,1:4,5120,64) -> Half(408000,136000,1:4,1700,20) *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Reshape + /model.77/Transpose (Shuffle) [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0888686 [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0536884 [04/18/2023-18:34:03] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0536884 [04/18/2023-18:34:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Half(204800,1:8,2560,32) -> Half(204000,68000,1:8,850,10) *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Reshape + /model.77/Transpose (Shuffle) [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0887954 [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.031307 [04/18/2023-18:34:03] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.031307 [04/18/2023-18:34:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Half(102400,1:16,1280,16) -> Half(102000,34000,1:16,425,5) *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Reshape + /model.77/Transpose (Shuffle) [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0887223 [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0314597 [04/18/2023-18:34:03] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0314597 [04/18/2023-18:34:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Half(51200,6400:32,80,1) -> Half(61200,20400,6800:32,85,1) *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Reshape + /model.77/Transpose (Shuffle) [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0721326 [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0337573 [04/18/2023-18:34:03] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0337573 [04/18/2023-18:34:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:34:03] [V] [TRT] =============== Computing costs for [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Float(1632000,544000,6800,85,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Split (Slice) [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00329683 [04/18/2023-18:34:03] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00329683 [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Split (Padding) [04/18/2023-18:34:03] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:34:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Half(1632000,544000,6800,85,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Split (Slice) [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00359143 [04/18/2023-18:34:03] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00359143 [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Split (Padding) [04/18/2023-18:34:03] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:34:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Half(816000,272000,6800:2,85,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Split (Padding) [04/18/2023-18:34:03] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Half(204000,68000,1:8,850,10) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Split (Padding) [04/18/2023-18:34:03] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:34:03] [V] [TRT] =============== Computing costs for [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Float(1632000,544000,6800,85,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Split_110 (Slice) [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0033066 [04/18/2023-18:34:03] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0033066 [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Split_110 (Padding) [04/18/2023-18:34:03] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:34:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Half(1632000,544000,6800,85,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Split_110 (Slice) [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00332619 [04/18/2023-18:34:03] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00332619 [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Split_110 (Padding) [04/18/2023-18:34:03] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:34:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Half(816000,272000,6800:2,85,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Split_110 (Padding) [04/18/2023-18:34:03] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Half(204000,68000,1:8,850,10) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Split_110 (Padding) [04/18/2023-18:34:03] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:34:03] [V] [TRT] =============== Computing costs for [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Float(1632000,544000,6800,85,1) -> Float(1632000,544000,6800,85,1) long-strided *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Split_111 (Slice) [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0222576 [04/18/2023-18:34:03] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0222576 [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Split_111 (Padding) [04/18/2023-18:34:03] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:34:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Float(1632000,544000,6800,85,1) -> Float(1555200,518400,6480,81,1) *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Split_111 (Slice) [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0219468 [04/18/2023-18:34:03] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0219468 [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Split_111 (Padding) [04/18/2023-18:34:03] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:34:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Half(1632000,544000,6800,85,1) -> Half(1632000,544000,6800,85,1) long-strided *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Split_111 (Slice) [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0148155 [04/18/2023-18:34:03] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0148155 [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Split_111 (Padding) [04/18/2023-18:34:03] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:34:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Half(1632000,544000,6800,85,1) -> Half(1555200,518400,6480,81,1) *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Split_111 (Slice) [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0139848 [04/18/2023-18:34:03] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0139848 [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Split_111 (Padding) [04/18/2023-18:34:03] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:34:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Half(816000,272000,6800:2,85,1) -> Half(816000,272000,6800:2,85,1) long-strided *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Split_111 (Padding) [04/18/2023-18:34:03] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Half(816000,272000,6800:2,85,1) -> Half(777600,259200,6480:2,81,1) *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Split_111 (Padding) [04/18/2023-18:34:03] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Half(204000,68000,1:8,850,10) -> Half(204000,68000,1:8,850,10) long-strided *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Split_111 (Padding) [04/18/2023-18:34:03] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Half(204000,68000,1:8,850,10) -> Half(194400,64800,1:8,810,10) *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: /model.77/Split_111 (Padding) [04/18/2023-18:34:03] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:34:03] [V] [TRT] =============== Computing costs for [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear + /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:34:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear + /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:34:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:4,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear + /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:34:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear + /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:34:03] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear + /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:34:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear + /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:34:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear + /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:34:03] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear + /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:34:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Int8(3200,1600:32,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:34:03] [V] [TRT] =============== Computing costs for [04/18/2023-18:34:03] [V] [TRT] *************** Autotuning format combination: Float(38400,12800,160,2,1), Float(12800,12800,160,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:34:03] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00295725 [04/18/2023-18:34:03] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00299514 [04/18/2023-18:34:04] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00306957 [04/18/2023-18:34:04] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0032322 [04/18/2023-18:34:04] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00311682 [04/18/2023-18:34:04] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00295995 [04/18/2023-18:34:04] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00390326 [04/18/2023-18:34:04] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00329673 [04/18/2023-18:34:05] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00304097 [04/18/2023-18:34:05] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00309651 [04/18/2023-18:34:05] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00272043 [04/18/2023-18:34:05] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00272043 [04/18/2023-18:34:05] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWise) [04/18/2023-18:34:05] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:34:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:34:05] [V] [TRT] *************** Autotuning format combination: Float(38400,12800,160,2,1), Float(12800,12800,160,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:34:05] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-18:34:05] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00286098 [04/18/2023-18:34:05] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00289307 [04/18/2023-18:34:05] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00283088 [04/18/2023-18:34:06] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00317613 [04/18/2023-18:34:06] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00308124 [04/18/2023-18:34:06] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00283724 [04/18/2023-18:34:06] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00392117 [04/18/2023-18:34:06] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00333842 [04/18/2023-18:34:07] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00303543 [04/18/2023-18:34:07] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00306879 [04/18/2023-18:34:07] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00323169 [04/18/2023-18:34:07] [V] [TRT] Fastest Tactic: 0x0000000000000002 Time: 0.00283088 [04/18/2023-18:34:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000002 [04/18/2023-18:34:07] [V] [TRT] *************** Autotuning format combination: Float(38400,12800,1,160,80), Float(12800,12800,1,160,80) -> Float(38400,12800,1,160,80) *************** [04/18/2023-18:34:07] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-18:34:07] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00306354 [04/18/2023-18:34:07] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00303819 [04/18/2023-18:34:07] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0029088 [04/18/2023-18:34:07] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00322235 [04/18/2023-18:34:07] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00308124 [04/18/2023-18:34:07] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00304885 [04/18/2023-18:34:07] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00389745 [04/18/2023-18:34:07] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00329247 [04/18/2023-18:34:07] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00309612 [04/18/2023-18:34:07] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00306675 [04/18/2023-18:34:07] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00304856 [04/18/2023-18:34:07] [V] [TRT] Fastest Tactic: 0x0000000000000002 Time: 0.0029088 [04/18/2023-18:34:07] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWise) [04/18/2023-18:34:07] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:34:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000002 [04/18/2023-18:34:07] [V] [TRT] *************** Autotuning format combination: Float(9600,3200,1:4,40,20), Float(3200,3200,1:4,40,20) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-18:34:07] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-18:34:07] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00319208 [04/18/2023-18:34:07] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00344229 [04/18/2023-18:34:07] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00379489 [04/18/2023-18:34:08] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00391154 [04/18/2023-18:34:08] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00373978 [04/18/2023-18:34:08] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00390573 [04/18/2023-18:34:08] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00532402 [04/18/2023-18:34:08] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0050519 [04/18/2023-18:34:09] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00510628 [04/18/2023-18:34:09] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00545033 [04/18/2023-18:34:09] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00314802 [04/18/2023-18:34:09] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00319675 [04/18/2023-18:34:09] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00314574 [04/18/2023-18:34:09] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0034511 [04/18/2023-18:34:10] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00375056 [04/18/2023-18:34:10] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00382244 [04/18/2023-18:34:10] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00423597 [04/18/2023-18:34:10] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00475753 [04/18/2023-18:34:10] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00512278 [04/18/2023-18:34:11] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0061581 [04/18/2023-18:34:11] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00341148 [04/18/2023-18:34:11] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00318405 [04/18/2023-18:34:11] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0036072 [04/18/2023-18:34:11] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00387682 [04/18/2023-18:34:11] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00325652 [04/18/2023-18:34:12] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00317277 [04/18/2023-18:34:12] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00344577 [04/18/2023-18:34:12] [V] [TRT] Fastest Tactic: 0x000000000000000c Time: 0.00314574 [04/18/2023-18:34:12] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWise) [04/18/2023-18:34:12] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:34:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000000c [04/18/2023-18:34:12] [V] [TRT] *************** Autotuning format combination: Float(1440,480,160:32,2,1), Float(480,480,160:32,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-18:34:12] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-18:34:12] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00337361 [04/18/2023-18:34:12] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00398133 [04/18/2023-18:34:12] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00513567 [04/18/2023-18:34:13] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00760445 [04/18/2023-18:34:13] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00313371 [04/18/2023-18:34:13] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00313371 [04/18/2023-18:34:13] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWise) [04/18/2023-18:34:13] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:34:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-18:34:13] [V] [TRT] *************** Autotuning format combination: Float(1440,480,160:32,2,1), Float(480,480,160:32,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-18:34:13] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-18:34:13] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0035345 [04/18/2023-18:34:13] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00560422 [04/18/2023-18:34:13] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00851415 [04/18/2023-18:34:13] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0139204 [04/18/2023-18:34:14] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00318923 [04/18/2023-18:34:14] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00354174 [04/18/2023-18:34:14] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0046546 [04/18/2023-18:34:14] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00671273 [04/18/2023-18:34:14] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00351364 [04/18/2023-18:34:15] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00310487 [04/18/2023-18:34:15] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00310487 [04/18/2023-18:34:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-18:34:15] [V] [TRT] *************** Autotuning format combination: Float(12800,1:4,160,2,1), Float(12800,1:4,160,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:34:15] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-18:34:15] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00295342 [04/18/2023-18:34:15] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00302514 [04/18/2023-18:34:15] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00289682 [04/18/2023-18:34:15] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.00289682 [04/18/2023-18:34:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [04/18/2023-18:34:15] [V] [TRT] *************** Autotuning format combination: Half(38400,12800,160,2,1), Half(12800,12800,160,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:34:15] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-18:34:15] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00295445 [04/18/2023-18:34:15] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00288786 [04/18/2023-18:34:16] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00279297 [04/18/2023-18:34:16] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00318578 [04/18/2023-18:34:16] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00298257 [04/18/2023-18:34:16] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00288558 [04/18/2023-18:34:16] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00389202 [04/18/2023-18:34:16] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.003355 [04/18/2023-18:34:17] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0030359 [04/18/2023-18:34:17] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00291118 [04/18/2023-18:34:17] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00277899 [04/18/2023-18:34:17] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00277899 [04/18/2023-18:34:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:34:17] [V] [TRT] *************** Autotuning format combination: Half(38400,12800,160,2,1), Half(12800,12800,160,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:34:17] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-18:34:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00302057 [04/18/2023-18:34:17] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00288229 [04/18/2023-18:34:17] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00281663 [04/18/2023-18:34:18] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00326369 [04/18/2023-18:34:18] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00291383 [04/18/2023-18:34:18] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0028832 [04/18/2023-18:34:18] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00401702 [04/18/2023-18:34:18] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00337924 [04/18/2023-18:34:18] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00309563 [04/18/2023-18:34:19] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00360263 [04/18/2023-18:34:19] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00284522 [04/18/2023-18:34:19] [V] [TRT] Fastest Tactic: 0x0000000000000002 Time: 0.00281663 [04/18/2023-18:34:19] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWise) [04/18/2023-18:34:19] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:34:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000002 [04/18/2023-18:34:19] [V] [TRT] *************** Autotuning format combination: Half(19200,6400,160:2,2,1), Half(6400,6400,160:2,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-18:34:19] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-18:34:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270767 [04/18/2023-18:34:19] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00294344 [04/18/2023-18:34:19] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00308717 [04/18/2023-18:34:19] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00339742 [04/18/2023-18:34:20] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00344903 [04/18/2023-18:34:20] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00337393 [04/18/2023-18:34:20] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00436433 [04/18/2023-18:34:20] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0043423 [04/18/2023-18:34:20] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00433011 [04/18/2023-18:34:21] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00435616 [04/18/2023-18:34:21] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00284719 [04/18/2023-18:34:21] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00286574 [04/18/2023-18:34:21] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00273225 [04/18/2023-18:34:21] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00337743 [04/18/2023-18:34:22] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00313103 [04/18/2023-18:34:22] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00283473 [04/18/2023-18:34:22] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00400063 [04/18/2023-18:34:22] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0035064 [04/18/2023-18:34:22] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00320853 [04/18/2023-18:34:22] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00314007 [04/18/2023-18:34:23] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0026869 [04/18/2023-18:34:23] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00292818 [04/18/2023-18:34:23] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.0026869 [04/18/2023-18:34:23] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWise) [04/18/2023-18:34:23] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:34:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:34:23] [V] [TRT] *************** Autotuning format combination: Half(4800,1600,1:8,20,10), Half(1600,1600,1:8,20,10) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-18:34:23] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-18:34:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00274001 [04/18/2023-18:34:23] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00330847 [04/18/2023-18:34:23] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00344653 [04/18/2023-18:34:24] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00394885 [04/18/2023-18:34:24] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00446514 [04/18/2023-18:34:24] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00431086 [04/18/2023-18:34:24] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00540783 [04/18/2023-18:34:24] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00639881 [04/18/2023-18:34:25] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00621953 [04/18/2023-18:34:25] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00632964 [04/18/2023-18:34:25] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00278681 [04/18/2023-18:34:25] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00306597 [04/18/2023-18:34:26] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00312368 [04/18/2023-18:34:26] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00369805 [04/18/2023-18:34:26] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00378105 [04/18/2023-18:34:26] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00379032 [04/18/2023-18:34:26] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00494944 [04/18/2023-18:34:26] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00525012 [04/18/2023-18:34:27] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00508469 [04/18/2023-18:34:27] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00518416 [04/18/2023-18:34:27] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00288055 [04/18/2023-18:34:27] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00300705 [04/18/2023-18:34:27] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.003552 [04/18/2023-18:34:28] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00451271 [04/18/2023-18:34:28] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00302152 [04/18/2023-18:34:28] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00299143 [04/18/2023-18:34:28] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00329652 [04/18/2023-18:34:28] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00405003 [04/18/2023-18:34:29] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0027549 [04/18/2023-18:34:29] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0027564 [04/18/2023-18:34:29] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00292348 [04/18/2023-18:34:29] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00321828 [04/18/2023-18:34:29] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00274001 [04/18/2023-18:34:29] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWise) [04/18/2023-18:34:29] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:34:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 [04/18/2023-18:34:29] [V] [TRT] *************** Autotuning format combination: Half(2400,800,1:16,10,5), Half(800,800,1:16,10,5) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-18:34:29] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-18:34:29] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00285742 [04/18/2023-18:34:29] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0032063 [04/18/2023-18:34:30] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00351063 [04/18/2023-18:34:30] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00409783 [04/18/2023-18:34:30] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00449929 [04/18/2023-18:34:30] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00438081 [04/18/2023-18:34:30] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00575689 [04/18/2023-18:34:31] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00655106 [04/18/2023-18:34:31] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00649662 [04/18/2023-18:34:31] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00652073 [04/18/2023-18:34:31] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00289216 [04/18/2023-18:34:31] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00304379 [04/18/2023-18:34:32] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00371798 [04/18/2023-18:34:32] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00501312 [04/18/2023-18:34:32] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00269965 [04/18/2023-18:34:32] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00306208 [04/18/2023-18:34:32] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0035896 [04/18/2023-18:34:32] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00459529 [04/18/2023-18:34:33] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00281018 [04/18/2023-18:34:33] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00278189 [04/18/2023-18:34:33] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00274778 [04/18/2023-18:34:33] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.00269965 [04/18/2023-18:34:33] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWise) [04/18/2023-18:34:33] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:34:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-18:34:33] [V] [TRT] *************** Autotuning format combination: Half(1440,480,160:32,2,1), Half(480,480,160:32,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-18:34:33] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-18:34:33] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00291109 [04/18/2023-18:34:33] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00304866 [04/18/2023-18:34:34] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00354018 [04/18/2023-18:34:34] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00465888 [04/18/2023-18:34:34] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00295109 [04/18/2023-18:34:34] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.00291109 [04/18/2023-18:34:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-18:34:34] [V] [TRT] *************** Autotuning format combination: Half(1440,480,160:32,2,1), Half(480,480,160:32,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-18:34:34] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-18:34:34] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00301048 [04/18/2023-18:34:34] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00368035 [04/18/2023-18:34:34] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00470901 [04/18/2023-18:34:35] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00708789 [04/18/2023-18:34:35] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0029704 [04/18/2023-18:34:35] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00311702 [04/18/2023-18:34:35] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00377732 [04/18/2023-18:34:35] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00488335 [04/18/2023-18:34:36] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00298838 [04/18/2023-18:34:36] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0028672 [04/18/2023-18:34:36] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.0028672 [04/18/2023-18:34:36] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWise) [04/18/2023-18:34:36] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:34:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-18:34:36] [V] [TRT] *************** Autotuning format combination: Half(12800,1:8,160,2,1), Half(12800,1:8,160,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:34:36] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-18:34:36] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00318364 [04/18/2023-18:34:36] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00331262 [04/18/2023-18:34:36] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00331678 [04/18/2023-18:34:36] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00341584 [04/18/2023-18:34:36] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00318364 [04/18/2023-18:34:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:34:36] [V] [TRT] *************** Autotuning format combination: Half(12800,12800:32,160,2,1), Half(12800,12800:32,160,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:34:36] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) (PointWiseV2) [04/18/2023-18:34:37] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00495622 [04/18/2023-18:34:37] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00527037 [04/18/2023-18:34:37] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00588544 [04/18/2023-18:34:37] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00779813 [04/18/2023-18:34:37] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00498191 [04/18/2023-18:34:38] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00515771 [04/18/2023-18:34:38] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00550769 [04/18/2023-18:34:38] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00670774 [04/18/2023-18:34:38] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0050694 [04/18/2023-18:34:38] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00506246 [04/18/2023-18:34:38] [V] [TRT] Fastest Tactic: 0x0000000000000014 Time: 0.00495622 [04/18/2023-18:34:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000014 [04/18/2023-18:34:38] [V] [TRT] =============== Computing costs for [04/18/2023-18:34:38] [V] [TRT] *************** Autotuning format combination: Float(38400,12800,160,2,1), Float(6,2,2,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:34:38] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-18:34:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0108206 [04/18/2023-18:34:39] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0128632 [04/18/2023-18:34:39] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0118731 [04/18/2023-18:34:39] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0146597 [04/18/2023-18:34:39] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0157111 [04/18/2023-18:34:39] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0132389 [04/18/2023-18:34:40] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.017884 [04/18/2023-18:34:40] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0184109 [04/18/2023-18:34:40] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0184029 [04/18/2023-18:34:40] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0167284 [04/18/2023-18:34:40] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00299343 [04/18/2023-18:34:40] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00299343 [04/18/2023-18:34:40] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWise) [04/18/2023-18:34:40] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:34:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:34:40] [V] [TRT] *************** Autotuning format combination: Float(38400,12800,160,2,1), Float(6,2,2,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:34:40] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-18:34:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0109091 [04/18/2023-18:34:41] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.013024 [04/18/2023-18:34:41] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0120072 [04/18/2023-18:34:41] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0148581 [04/18/2023-18:34:41] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0159543 [04/18/2023-18:34:41] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0131013 [04/18/2023-18:34:41] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0181703 [04/18/2023-18:34:42] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.020204 [04/18/2023-18:34:42] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0186343 [04/18/2023-18:34:42] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0162966 [04/18/2023-18:34:42] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00300467 [04/18/2023-18:34:42] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00300467 [04/18/2023-18:34:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:34:42] [V] [TRT] *************** Autotuning format combination: Float(38400,12800,1,160,80), Float(6,2,1,2,1) -> Float(38400,12800,1,160,80) *************** [04/18/2023-18:34:42] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-18:34:42] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00303848 [04/18/2023-18:34:42] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0039934 [04/18/2023-18:34:43] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00288393 [04/18/2023-18:34:43] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00313908 [04/18/2023-18:34:43] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00308299 [04/18/2023-18:34:43] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00274018 [04/18/2023-18:34:43] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00333682 [04/18/2023-18:34:44] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00317515 [04/18/2023-18:34:44] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00301381 [04/18/2023-18:34:44] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00282694 [04/18/2023-18:34:44] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00324693 [04/18/2023-18:34:44] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.00274018 [04/18/2023-18:34:44] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWise) [04/18/2023-18:34:44] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:34:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [04/18/2023-18:34:44] [V] [TRT] *************** Autotuning format combination: Float(9600,3200,1:4,40,20), Float(6,2,1:4,2,1) -> Float(9600,3200,1:4,40,20) *************** [04/18/2023-18:34:44] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-18:34:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00299505 [04/18/2023-18:34:45] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00314325 [04/18/2023-18:34:45] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00353907 [04/18/2023-18:34:45] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00329174 [04/18/2023-18:34:45] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00335543 [04/18/2023-18:34:45] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00313451 [04/18/2023-18:34:45] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00352335 [04/18/2023-18:34:46] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00357646 [04/18/2023-18:34:46] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00342694 [04/18/2023-18:34:46] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00336064 [04/18/2023-18:34:46] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00295846 [04/18/2023-18:34:46] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0030825 [04/18/2023-18:34:47] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0032323 [04/18/2023-18:34:47] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00328675 [04/18/2023-18:34:47] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0033785 [04/18/2023-18:34:47] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00345578 [04/18/2023-18:34:47] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0034179 [04/18/2023-18:34:48] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00358994 [04/18/2023-18:34:48] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00368246 [04/18/2023-18:34:48] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00396046 [04/18/2023-18:34:48] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0030434 [04/18/2023-18:34:48] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00314991 [04/18/2023-18:34:49] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00317684 [04/18/2023-18:34:49] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00341344 [04/18/2023-18:34:49] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00305226 [04/18/2023-18:34:49] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00283249 [04/18/2023-18:34:49] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00312318 [04/18/2023-18:34:49] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.00283249 [04/18/2023-18:34:49] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWise) [04/18/2023-18:34:49] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:34:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [04/18/2023-18:34:49] [V] [TRT] *************** Autotuning format combination: Float(1440,480,160:32,2,1), Float(6,2,2:32,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-18:34:49] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-18:34:49] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00326088 [04/18/2023-18:34:50] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00359874 [04/18/2023-18:34:50] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00373017 [04/18/2023-18:34:50] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00420894 [04/18/2023-18:34:50] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00309379 [04/18/2023-18:34:50] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00309379 [04/18/2023-18:34:50] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWise) [04/18/2023-18:34:50] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:34:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-18:34:50] [V] [TRT] *************** Autotuning format combination: Float(1440,480,160:32,2,1), Float(6,2,2:32,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-18:34:50] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-18:34:50] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00385504 [04/18/2023-18:34:51] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00496946 [04/18/2023-18:34:51] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00533926 [04/18/2023-18:34:51] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00601505 [04/18/2023-18:34:51] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00329434 [04/18/2023-18:34:51] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00346177 [04/18/2023-18:34:52] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0036456 [04/18/2023-18:34:52] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00408424 [04/18/2023-18:34:52] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00341986 [04/18/2023-18:34:52] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00306383 [04/18/2023-18:34:52] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00306383 [04/18/2023-18:34:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-18:34:52] [V] [TRT] *************** Autotuning format combination: Float(12800,1:4,160,2,1), Float(2,1:4,2,2,1) -> Float(12800,1:4,160,2,1) *************** [04/18/2023-18:34:52] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-18:34:52] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00322174 [04/18/2023-18:34:53] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00301809 [04/18/2023-18:34:53] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00340212 [04/18/2023-18:34:53] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.00301809 [04/18/2023-18:34:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [04/18/2023-18:34:53] [V] [TRT] *************** Autotuning format combination: Half(38400,12800,160,2,1), Half(6,2,2,2,1) -> Float(38400,12800,160,2,1) *************** [04/18/2023-18:34:53] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-18:34:53] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0111838 [04/18/2023-18:34:53] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0131125 [04/18/2023-18:34:53] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.012056 [04/18/2023-18:34:53] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0151698 [04/18/2023-18:34:54] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0159416 [04/18/2023-18:34:54] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.013056 [04/18/2023-18:34:54] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.019004 [04/18/2023-18:34:54] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0204199 [04/18/2023-18:34:54] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0182789 [04/18/2023-18:34:54] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0165465 [04/18/2023-18:34:55] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00300086 [04/18/2023-18:34:55] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00300086 [04/18/2023-18:34:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:34:55] [V] [TRT] *************** Autotuning format combination: Half(38400,12800,160,2,1), Half(6,2,2,2,1) -> Half(38400,12800,160,2,1) *************** [04/18/2023-18:34:55] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-18:34:55] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.011116 [04/18/2023-18:34:55] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0132243 [04/18/2023-18:34:55] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0124453 [04/18/2023-18:34:55] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0152343 [04/18/2023-18:34:55] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0159162 [04/18/2023-18:34:56] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0132617 [04/18/2023-18:34:56] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0191594 [04/18/2023-18:34:56] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0198497 [04/18/2023-18:34:56] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.018688 [04/18/2023-18:34:56] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0163774 [04/18/2023-18:34:57] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00319583 [04/18/2023-18:34:57] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00319583 [04/18/2023-18:34:57] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWise) [04/18/2023-18:34:57] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:34:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:34:57] [V] [TRT] *************** Autotuning format combination: Half(19200,6400,160:2,2,1), Half(6,2,2:2,2,1) -> Half(19200,6400,160:2,2,1) *************** [04/18/2023-18:34:57] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-18:34:57] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00772331 [04/18/2023-18:34:57] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00889654 [04/18/2023-18:34:57] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00836978 [04/18/2023-18:34:57] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0105205 [04/18/2023-18:34:57] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00996693 [04/18/2023-18:34:58] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0081407 [04/18/2023-18:34:58] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0136686 [04/18/2023-18:34:58] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0114215 [04/18/2023-18:34:58] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0103259 [04/18/2023-18:34:58] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00936286 [04/18/2023-18:34:59] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00725349 [04/18/2023-18:34:59] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00859482 [04/18/2023-18:34:59] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00750674 [04/18/2023-18:34:59] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0103749 [04/18/2023-18:34:59] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00942971 [04/18/2023-18:35:00] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00764078 [04/18/2023-18:35:00] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0141315 [04/18/2023-18:35:00] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0116737 [04/18/2023-18:35:00] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0101498 [04/18/2023-18:35:00] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00809803 [04/18/2023-18:35:00] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0032387 [04/18/2023-18:35:01] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00313312 [04/18/2023-18:35:01] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.00313312 [04/18/2023-18:35:01] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWise) [04/18/2023-18:35:01] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [04/18/2023-18:35:01] [V] [TRT] *************** Autotuning format combination: Half(4800,1600,1:8,20,10), Half(6,2,1:8,2,1) -> Half(4800,1600,1:8,20,10) *************** [04/18/2023-18:35:01] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-18:35:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00347287 [04/18/2023-18:35:01] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00367508 [04/18/2023-18:35:01] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0038151 [04/18/2023-18:35:01] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00403581 [04/18/2023-18:35:02] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00406832 [04/18/2023-18:35:02] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00380415 [04/18/2023-18:35:02] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0041455 [04/18/2023-18:35:02] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00431449 [04/18/2023-18:35:02] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00413231 [04/18/2023-18:35:03] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00391685 [04/18/2023-18:35:03] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00336351 [04/18/2023-18:35:03] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00336404 [04/18/2023-18:35:03] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00335575 [04/18/2023-18:35:04] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0037659 [04/18/2023-18:35:04] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0035035 [04/18/2023-18:35:04] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00325631 [04/18/2023-18:35:04] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00391487 [04/18/2023-18:35:04] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00378286 [04/18/2023-18:35:05] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00378214 [04/18/2023-18:35:05] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0034068 [04/18/2023-18:35:05] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00323566 [04/18/2023-18:35:05] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00342792 [04/18/2023-18:35:05] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00367297 [04/18/2023-18:35:05] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00404546 [04/18/2023-18:35:06] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00326847 [04/18/2023-18:35:06] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00326078 [04/18/2023-18:35:06] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00322215 [04/18/2023-18:35:06] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00354052 [04/18/2023-18:35:06] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00316929 [04/18/2023-18:35:07] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00307531 [04/18/2023-18:35:07] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00311662 [04/18/2023-18:35:07] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00311702 [04/18/2023-18:35:07] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.00307531 [04/18/2023-18:35:07] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWise) [04/18/2023-18:35:07] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [04/18/2023-18:35:07] [V] [TRT] *************** Autotuning format combination: Half(2400,800,1:16,10,5), Half(6,2,1:16,2,1) -> Half(2400,800,1:16,10,5) *************** [04/18/2023-18:35:07] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-18:35:07] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0033869 [04/18/2023-18:35:07] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00356003 [04/18/2023-18:35:07] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00359211 [04/18/2023-18:35:08] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00378707 [04/18/2023-18:35:08] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00397511 [04/18/2023-18:35:08] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00372689 [04/18/2023-18:35:08] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00415477 [04/18/2023-18:35:08] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00434327 [04/18/2023-18:35:09] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00422239 [04/18/2023-18:35:09] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00420383 [04/18/2023-18:35:09] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00325527 [04/18/2023-18:35:09] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00326743 [04/18/2023-18:35:10] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00375988 [04/18/2023-18:35:10] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00397625 [04/18/2023-18:35:10] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00323779 [04/18/2023-18:35:10] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00345067 [04/18/2023-18:35:10] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00359749 [04/18/2023-18:35:10] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0041489 [04/18/2023-18:35:11] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00329558 [04/18/2023-18:35:11] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00314415 [04/18/2023-18:35:11] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00305731 [04/18/2023-18:35:11] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00305731 [04/18/2023-18:35:11] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWise) [04/18/2023-18:35:11] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-18:35:11] [V] [TRT] *************** Autotuning format combination: Half(1440,480,160:32,2,1), Half(6,2,2:32,2,1) -> Float(1440,480,160:32,2,1) *************** [04/18/2023-18:35:11] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-18:35:11] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00314286 [04/18/2023-18:35:11] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00331345 [04/18/2023-18:35:12] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00356282 [04/18/2023-18:35:12] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00392624 [04/18/2023-18:35:12] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00304982 [04/18/2023-18:35:12] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00304982 [04/18/2023-18:35:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-18:35:12] [V] [TRT] *************** Autotuning format combination: Half(1440,480,160:32,2,1), Half(6,2,2:32,2,1) -> Half(1440,480,160:32,2,1) *************** [04/18/2023-18:35:12] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-18:35:12] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00336904 [04/18/2023-18:35:12] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00392315 [04/18/2023-18:35:13] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00486705 [04/18/2023-18:35:13] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00626107 [04/18/2023-18:35:13] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00306042 [04/18/2023-18:35:13] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0033718 [04/18/2023-18:35:13] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00374705 [04/18/2023-18:35:13] [V] [TRT] Tactic: 0x000000000000001b Time: 0.004587 [04/18/2023-18:35:14] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00308318 [04/18/2023-18:35:14] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00308056 [04/18/2023-18:35:14] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.00306042 [04/18/2023-18:35:14] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWise) [04/18/2023-18:35:14] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-18:35:14] [V] [TRT] *************** Autotuning format combination: Half(12800,1:8,160,2,1), Half(2,1:8,2,2,1) -> Half(12800,1:8,160,2,1) *************** [04/18/2023-18:35:14] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-18:35:14] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00320345 [04/18/2023-18:35:14] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0032641 [04/18/2023-18:35:14] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00372208 [04/18/2023-18:35:15] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00454943 [04/18/2023-18:35:15] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00320345 [04/18/2023-18:35:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:35:15] [V] [TRT] *************** Autotuning format combination: Half(12800,12800:32,160,2,1), Half(2,2:32,2,2,1) -> Half(12800,12800:32,160,2,1) *************** [04/18/2023-18:35:15] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) (PointWiseV2) [04/18/2023-18:35:15] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00933857 [04/18/2023-18:35:15] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0125916 [04/18/2023-18:35:15] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0178306 [04/18/2023-18:35:15] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0291401 [04/18/2023-18:35:15] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00742423 [04/18/2023-18:35:16] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00896143 [04/18/2023-18:35:16] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0116125 [04/18/2023-18:35:16] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0177239 [04/18/2023-18:35:16] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00484191 [04/18/2023-18:35:16] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00534383 [04/18/2023-18:35:16] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.00484191 [04/18/2023-18:35:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [04/18/2023-18:35:16] [V] [TRT] =============== Computing costs for [04/18/2023-18:35:16] [V] [TRT] *************** Autotuning format combination: Float(1632000,544000,6800,85,1) -> Float(1632000,85,1) *************** [04/18/2023-18:35:16] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1 (Shuffle) [04/18/2023-18:35:16] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0255947 [04/18/2023-18:35:16] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0472869 [04/18/2023-18:35:16] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0255947 [04/18/2023-18:35:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-18:35:16] [V] [TRT] *************** Autotuning format combination: Float(1632000,544000,1,6800,80) -> Float(1,85,1) *************** [04/18/2023-18:35:16] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1 (Shuffle) [04/18/2023-18:35:16] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0361406 [04/18/2023-18:35:16] [V] [TRT] Tactic: 0x0000000000000001 Time: 1.08136 [04/18/2023-18:35:16] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0361406 [04/18/2023-18:35:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-18:35:16] [V] [TRT] *************** Autotuning format combination: Float(408000,136000,1:4,1700,20) -> Float(1:4,85,1) *************** [04/18/2023-18:35:16] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1 (Shuffle) [04/18/2023-18:35:16] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.858551 [04/18/2023-18:35:16] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.145554 [04/18/2023-18:35:16] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.145554 [04/18/2023-18:35:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:35:16] [V] [TRT] *************** Autotuning format combination: Float(61200,20400,6800:32,85,1) -> Float(1632000:32,85,1) *************** [04/18/2023-18:35:16] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1 (Shuffle) [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 8.25022 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.683154 [04/18/2023-18:35:17] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.683154 [04/18/2023-18:35:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Half(1632000,544000,6800,85,1) -> Half(1632000,85,1) *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1 (Shuffle) [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0162651 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0721189 [04/18/2023-18:35:17] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0162651 [04/18/2023-18:35:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Half(816000,272000,6800:2,85,1) -> Half(1632000:2,85,1) *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1 (Shuffle) [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.212699 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0738903 [04/18/2023-18:35:17] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0738903 [04/18/2023-18:35:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Half(408000,136000,1:4,1700,20) -> Half(1:4,85,1) *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1 (Shuffle) [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.463287 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.214601 [04/18/2023-18:35:17] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.214601 [04/18/2023-18:35:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Half(204000,68000,1:8,850,10) -> Half(1:8,85,1) *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1 (Shuffle) [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.982016 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.138254 [04/18/2023-18:35:17] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.138254 [04/18/2023-18:35:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Half(102000,34000,1:16,425,5) -> Half(1:16,85,1) *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1 (Shuffle) [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 2.04683 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.21387 [04/18/2023-18:35:17] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.21387 [04/18/2023-18:35:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Half(61200,20400,6800:32,85,1) -> Half(1632000:32,85,1) *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_1 (Shuffle) [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 4.13184 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.196023 [04/18/2023-18:35:17] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.196023 [04/18/2023-18:35:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:35:17] [V] [TRT] =============== Computing costs for [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600,40,1) -> Int8(409600,1600,40,1) long-strided *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600,40,1) -> Int8(102400,1600,40,1) *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:4,40,1) -> Int8(102400,1600:4,40,1) long-strided *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:35:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:35:17] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:4,40,1) -> Int8(12800,1600:32,40,1) long-strided *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:4,40,1) -> Int8(25600,1600:4,40,1) *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:35:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:35:17] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Int8(25600,1600:4,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Int8(3200,1600:32,40,1) -> Int8(12800,1600:32,40,1) long-strided *************** [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Int8(3200,1600:32,40,1) -> Int8(3200,1600:32,40,1) *************** [04/18/2023-18:35:17] [V] [TRT] =============== Computing costs for [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Int8(409600,1600,40,1) -> Int8(204800,1600,40,1) *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear + /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear + /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(51200,1600:4,40,1) *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear + /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:35:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear + /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:35:17] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear + /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear + /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear + /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear + /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Int8(6400,1600:32,40,1) *************** [04/18/2023-18:35:17] [V] [TRT] =============== Computing costs for [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Float(204800,400,20,1) long-strided *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:35:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 Tactic: 0x127de12a1f1a4809 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x127de12a1f1a4809 Time: 0.0511512 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.0498347 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.035723 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.039424 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0364251 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.0498834 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0314514 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 Tactic: 0x1b0534177b414e71 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x1b0534177b414e71 Time: 0.033675 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.0329435 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.0421303 [04/18/2023-18:35:17] [V] [TRT] Fastest Tactic: 0x4d9d0d03129bceb1 Time: 0.0314514 [04/18/2023-18:35:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4d9d0d03129bceb1 [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Float(102400,400,20,1) *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:35:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 Tactic: 0x127de12a1f1a4809 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x127de12a1f1a4809 Time: 0.0506149 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.0497371 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.0356882 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.0392777 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0364251 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.0498773 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0313051 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 Tactic: 0x1b0534177b414e71 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x1b0534177b414e71 Time: 0.0336457 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.0328503 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.0421303 [04/18/2023-18:35:17] [V] [TRT] Fastest Tactic: 0x4d9d0d03129bceb1 Time: 0.0313051 [04/18/2023-18:35:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x4d9d0d03129bceb1 [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Float(204800,400,20,1) long-strided *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x2bcbba39f608bf10 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x2bcbba39f608bf10 Time: 0.0141523 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x85c1a5f7f239cf84 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x85c1a5f7f239cf84 Time: 0.0104258 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0xac914b235d066808 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xac914b235d066808 Time: 0.0206054 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0xa8b56a226b057463 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xa8b56a226b057463 Time: 0.0113389 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x64x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x23b890da05937b9e [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x23b890da05937b9e Time: 0.0132189 [04/18/2023-18:35:17] [V] [TRT] Fastest Tactic: 0x85c1a5f7f239cf84 Time: 0.0104258 [04/18/2023-18:35:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x85c1a5f7f239cf84 [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Float(6400,400:32,20,1) long-strided *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskJitConv) [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3d41ef6de22d9b6 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xd3d41ef6de22d9b6 Time: 0.0171586 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0302226 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00730103 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.0106501 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xf8d4389f60adfa3c [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xf8d4389f60adfa3c Time: 0.0299803 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.0071984 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x2f34f689bfca5071 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x2f34f689bfca5071 Time: 0.00700865 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x554e2e252e28b3fd [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x554e2e252e28b3fd Time: 0.0294464 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0299301 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x4749124f62d8bd23 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x4749124f62d8bd23 Time: 0.00709791 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3f592fae61c7986 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xd3f592fae61c7986 Time: 0.00664956 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0172815 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.0104921 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xbb88763c3b0e94d4 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xbb88763c3b0e94d4 Time: 0.00776806 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xea88b51105501f96 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xea88b51105501f96 Time: 0.0165521 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd30e9f770878c3fd [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xd30e9f770878c3fd Time: 0.0100203 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x53554c607d072468 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x53554c607d072468 Time: 0.0109587 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00805054 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.0112707 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00683886 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.0167472 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x705baf38e41eee0b [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x705baf38e41eee0b Time: 0.0101711 [04/18/2023-18:35:17] [V] [TRT] Fastest Tactic: 0xd3f592fae61c7986 Time: 0.00664956 [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x45f7566cdb2b10fb [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x45f7566cdb2b10fb Time: 0.0087516 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.0166603 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xea2b7420057a01c1 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xea2b7420057a01c1 Time: 0.0315977 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.0108428 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x2d8ab2aa0639fda9 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x2d8ab2aa0639fda9 Time: 0.00975665 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd14bd6d95fefd45e [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xd14bd6d95fefd45e Time: 0.00918543 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.00881963 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.0126019 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.0124202 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x0e07dc8353bf7e9f [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x0e07dc8353bf7e9f Time: 0.0189571 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x55edef142e02adaa [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x55edef142e02adaa Time: 0.0185417 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.0318025 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.0191583 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x0edd5d0285e564d4 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x0edd5d0285e564d4 Time: 0.0121699 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xb936321f82fd390c [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xb936321f82fd390c Time: 0.00887718 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.009344 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.009408 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xad886d4d69834922 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xad886d4d69834922 Time: 0.0122095 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0325339 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x47b1629a4bff4800 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x47b1629a4bff4800 Time: 0.031861 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.0103899 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.0193931 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.0214139 [04/18/2023-18:35:17] [V] [TRT] Fastest Tactic: 0x45f7566cdb2b10fb Time: 0.0087516 [04/18/2023-18:35:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0xd3f592fae61c7986 [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Half(6400,400:32,20,1) long-strided *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskJitConv) [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3d41ef6de22d9b6 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xd3d41ef6de22d9b6 Time: 0.0153394 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0262872 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.007176 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.00979261 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xf8d4389f60adfa3c [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xf8d4389f60adfa3c Time: 0.026096 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00711772 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x2f34f689bfca5071 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x2f34f689bfca5071 Time: 0.00690177 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x554e2e252e28b3fd [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x554e2e252e28b3fd Time: 0.0256533 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0259124 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x4749124f62d8bd23 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x4749124f62d8bd23 Time: 0.00699603 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3f592fae61c7986 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xd3f592fae61c7986 Time: 0.00622211 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0154761 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00955368 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xbb88763c3b0e94d4 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xbb88763c3b0e94d4 Time: 0.00736411 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xea88b51105501f96 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xea88b51105501f96 Time: 0.014869 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd30e9f770878c3fd [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xd30e9f770878c3fd Time: 0.00927629 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x53554c607d072468 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x53554c607d072468 Time: 0.0102168 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00777143 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.0105016 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00648288 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.0150798 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x705baf38e41eee0b [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x705baf38e41eee0b Time: 0.00954575 [04/18/2023-18:35:17] [V] [TRT] Fastest Tactic: 0xd3f592fae61c7986 Time: 0.00622211 [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0xd3f592fae61c7986 [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Float(102400,400,20,1) *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x2bcbba39f608bf10 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x2bcbba39f608bf10 Time: 0.0138365 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x85c1a5f7f239cf84 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x85c1a5f7f239cf84 Time: 0.0103073 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0xac914b235d066808 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xac914b235d066808 Time: 0.0203469 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0xa8b56a226b057463 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xa8b56a226b057463 Time: 0.0112042 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x64x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_alignc4 Tactic: 0x23b890da05937b9e [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x23b890da05937b9e Time: 0.0130963 [04/18/2023-18:35:17] [V] [TRT] Fastest Tactic: 0x85c1a5f7f239cf84 Time: 0.0103073 [04/18/2023-18:35:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x85c1a5f7f239cf84 [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskJitConv) [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3d41ef6de22d9b6 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xd3d41ef6de22d9b6 Time: 0.0170479 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.0302181 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00721554 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.0107458 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xf8d4389f60adfa3c [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xf8d4389f60adfa3c Time: 0.0299867 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.0071808 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x2f34f689bfca5071 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x2f34f689bfca5071 Time: 0.00700931 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x554e2e252e28b3fd [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x554e2e252e28b3fd Time: 0.029419 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0297545 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x4749124f62d8bd23 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x4749124f62d8bd23 Time: 0.00708615 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3f592fae61c7986 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xd3f592fae61c7986 Time: 0.00659844 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0172815 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.0104294 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xbb88763c3b0e94d4 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xbb88763c3b0e94d4 Time: 0.00776638 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xea88b51105501f96 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xea88b51105501f96 Time: 0.0165775 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd30e9f770878c3fd [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xd30e9f770878c3fd Time: 0.0100053 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x53554c607d072468 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x53554c607d072468 Time: 0.0109571 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00805714 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.0112605 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00683146 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.0167411 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x705baf38e41eee0b [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x705baf38e41eee0b Time: 0.0101647 [04/18/2023-18:35:17] [V] [TRT] Fastest Tactic: 0xd3f592fae61c7986 Time: 0.00659844 [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x45f7566cdb2b10fb [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x45f7566cdb2b10fb Time: 0.00873062 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.0165577 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xea2b7420057a01c1 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xea2b7420057a01c1 Time: 0.0315977 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.0107383 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x2d8ab2aa0639fda9 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x2d8ab2aa0639fda9 Time: 0.00970301 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd14bd6d95fefd45e [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xd14bd6d95fefd45e Time: 0.00916914 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.00882528 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.0125829 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.0123219 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x0e07dc8353bf7e9f [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x0e07dc8353bf7e9f Time: 0.018984 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x55edef142e02adaa [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x55edef142e02adaa Time: 0.0185331 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.0317129 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.0190691 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x0edd5d0285e564d4 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x0edd5d0285e564d4 Time: 0.0121413 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xb936321f82fd390c [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xb936321f82fd390c Time: 0.00886723 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.00930429 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.00938114 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xad886d4d69834922 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xad886d4d69834922 Time: 0.012165 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0324754 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x47b1629a4bff4800 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x47b1629a4bff4800 Time: 0.0318354 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.0103422 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.0192909 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.0213211 [04/18/2023-18:35:17] [V] [TRT] Fastest Tactic: 0x45f7566cdb2b10fb Time: 0.00873062 [04/18/2023-18:35:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0xd3f592fae61c7986 [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskJitConv) [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3d41ef6de22d9b6 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xd3d41ef6de22d9b6 Time: 0.0151959 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x80cce6d8f75dc163 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x80cce6d8f75dc163 Time: 0.026307 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x955d593b1135a423 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x955d593b1135a423 Time: 0.00715657 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5e1b696f91f572c0 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x5e1b696f91f572c0 Time: 0.0097923 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xf8d4389f60adfa3c [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xf8d4389f60adfa3c Time: 0.026064 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xee2fce9480a52be7 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xee2fce9480a52be7 Time: 0.00709159 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x2f34f689bfca5071 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x2f34f689bfca5071 Time: 0.00689219 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x554e2e252e28b3fd [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x554e2e252e28b3fd Time: 0.0256244 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x41b4640eb250ffd0 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x41b4640eb250ffd0 Time: 0.0259101 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x4749124f62d8bd23 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x4749124f62d8bd23 Time: 0.00700517 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3f592fae61c7986 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xd3f592fae61c7986 Time: 0.00624755 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x204424cb4da28c02 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x204424cb4da28c02 Time: 0.0154921 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3818ca0093333b50 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x3818ca0093333b50 Time: 0.00956404 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xbb88763c3b0e94d4 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xbb88763c3b0e94d4 Time: 0.0073504 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xea88b51105501f96 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xea88b51105501f96 Time: 0.0148315 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd30e9f770878c3fd [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xd30e9f770878c3fd Time: 0.00925629 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x53554c607d072468 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x53554c607d072468 Time: 0.0102122 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xf56c0ac895d82363 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xf56c0ac895d82363 Time: 0.00776445 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xeb33cf0799237780 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xeb33cf0799237780 Time: 0.0105012 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8e1e9d670448aca7 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x8e1e9d670448aca7 Time: 0.00651055 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8d50646eff0cde6d [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x8d50646eff0cde6d Time: 0.0150217 [04/18/2023-18:35:17] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0x705baf38e41eee0b [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x705baf38e41eee0b Time: 0.00953204 [04/18/2023-18:35:17] [V] [TRT] Fastest Tactic: 0xd3f592fae61c7986 Time: 0.00624755 [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskJitConv Tactic: 0xd3f592fae61c7986 [04/18/2023-18:35:17] [V] [TRT] =============== Computing costs for [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Int8(204800,1600,40,1) -> Int8(409600,1600,40,1) *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(102400,1600:4,40,1) *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:35:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:35:17] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Int8(51200,1600:4,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] *************** Autotuning format combination: Int8(6400,1600:32,40,1) -> Int8(12800,1600:32,40,1) *************** [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:35:17] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:35:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:35:17] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:17] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:17] [V] [TRT] --------------- Timing Runner: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:17] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.0149531 [04/18/2023-18:35:17] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.015584 [04/18/2023-18:35:17] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0134529 [04/18/2023-18:35:17] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.0143397 [04/18/2023-18:35:17] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.0146761 [04/18/2023-18:35:17] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.0105375 [04/18/2023-18:35:17] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.0108529 [04/18/2023-18:35:17] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.00966796 [04/18/2023-18:35:17] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00988038 [04/18/2023-18:35:17] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00987093 [04/18/2023-18:35:17] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0164241 [04/18/2023-18:35:17] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.00965394 [04/18/2023-18:35:17] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.0100227 [04/18/2023-18:35:17] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0166933 [04/18/2023-18:35:17] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0273554 [04/18/2023-18:35:17] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0151845 [04/18/2023-18:35:17] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0106958 [04/18/2023-18:35:17] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0273105 [04/18/2023-18:35:17] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:35:17] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0275558 [04/18/2023-18:35:17] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:35:17] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0120884 [04/18/2023-18:35:17] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0105352 [04/18/2023-18:35:18] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0190834 [04/18/2023-18:35:18] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0276792 [04/18/2023-18:35:18] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.0123204 [04/18/2023-18:35:18] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0186286 [04/18/2023-18:35:18] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0280648 [04/18/2023-18:35:18] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0280137 [04/18/2023-18:35:18] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0182114 [04/18/2023-18:35:18] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0108176 [04/18/2023-18:35:18] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.011501 [04/18/2023-18:35:18] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0157989 [04/18/2023-18:35:18] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0171642 [04/18/2023-18:35:18] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0166212 [04/18/2023-18:35:18] [V] [TRT] Fastest Tactic: 0xfbcd5a1da537e27f Time: 0.00965394 [04/18/2023-18:35:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xfbcd5a1da537e27f [04/18/2023-18:35:18] [V] [TRT] =============== Computing costs for [04/18/2023-18:35:18] [V] [TRT] *************** Autotuning format combination: Int8(102400,1600:4,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv (CudaDepthwiseConvolution) [04/18/2023-18:35:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv (CaskFlattenConvolution) [04/18/2023-18:35:18] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv (CaskConvolution) [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 0xc25454de2efcccdc [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xc25454de2efcccdc Time: 0.0121227 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: 0xff6944b17d5b2e32 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xff6944b17d5b2e32 Time: 0.0118505 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.0165501 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.0126023 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.014026 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.012989 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.0166258 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0121981 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 0x1db6e8cf1382fbe0 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x1db6e8cf1382fbe0 Time: 0.0165039 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: 0xa4ae2d82115c3e83 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xa4ae2d82115c3e83 Time: 0.0134188 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.0123524 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.0145458 [04/18/2023-18:35:18] [V] [TRT] Fastest Tactic: 0xff6944b17d5b2e32 Time: 0.0118505 [04/18/2023-18:35:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xff6944b17d5b2e32 [04/18/2023-18:35:18] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv (CaskFlattenConvolution) [04/18/2023-18:35:18] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv (CaskConvolution) [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x733ba2a91a48d431 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x733ba2a91a48d431 Time: 0.00782364 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0xf04572b287451f42 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xf04572b287451f42 Time: 0.00841869 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x5e4f6d7c83746fd6 Time: 0.00985173 [04/18/2023-18:35:18] [V] [TRT] Fastest Tactic: 0x733ba2a91a48d431 Time: 0.00782364 [04/18/2023-18:35:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x733ba2a91a48d431 [04/18/2023-18:35:18] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv (CaskFlattenConvolution) [04/18/2023-18:35:18] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv (CaskConvolution) [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa71946688cad8664 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xa71946688cad8664 Time: 0.00749623 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x1e55f8b415964e81 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x1e55f8b415964e81 Time: 0.00904857 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.00914629 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9003f5f7ff9b1aec [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x9003f5f7ff9b1aec Time: 0.014161 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9ec201b34455146e [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x9ec201b34455146e Time: 0.00787056 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x91930a570b557437 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x91930a570b557437 Time: 0.0140567 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdf7e1bd6a496d667 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xdf7e1bd6a496d667 Time: 0.00918314 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6d377e4222886190 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x6d377e4222886190 Time: 0.00845176 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x271b998fe31732ef [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x271b998fe31732ef Time: 0.00780006 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.00850958 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x960e9baa2a6cad5b [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x960e9baa2a6cad5b Time: 0.0077618 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.0086045 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x84942841d92b0552 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x84942841d92b0552 Time: 0.00940257 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xbeb5d91e1874a437 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xbeb5d91e1874a437 Time: 0.008978 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcd229658c16b33cd [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xcd229658c16b33cd Time: 0.014512 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.00765642 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.00799797 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x33a5c6dd086942c1 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x33a5c6dd086942c1 Time: 0.00805511 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7720f198395e7d3d [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x7720f198395e7d3d Time: 0.00756018 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.0144814 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.00923686 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x60b880e28fee7a0c [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x60b880e28fee7a0c Time: 0.0144823 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcf64a2ae51bf6b36 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xcf64a2ae51bf6b36 Time: 0.00871798 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x844ea9c00f711f19 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x844ea9c00f711f19 Time: 0.00779549 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x65fbe45b4cb1d8a5 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x65fbe45b4cb1d8a5 Time: 0.00858864 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.00809676 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.00853432 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5bd8221bd57baf93 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x5bd8221bd57baf93 Time: 0.00854776 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0148174 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.00765305 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.00965577 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6e9c17a33c93d9b0 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x6e9c17a33c93d9b0 Time: 0.00759338 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.00990232 [04/18/2023-18:35:18] [V] [TRT] Fastest Tactic: 0xa71946688cad8664 Time: 0.00749623 [04/18/2023-18:35:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa71946688cad8664 [04/18/2023-18:35:18] [V] [TRT] *************** Autotuning format combination: Int8(12800,1600:32,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv (CaskFlattenConvolution) [04/18/2023-18:35:18] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv (CaskConvolution) [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5812ced7874b44d1 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x5812ced7874b44d1 Time: 0.00587721 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x43e3804f158e597d [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x43e3804f158e597d Time: 0.00709573 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7524377e24bc511f [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x7524377e24bc511f Time: 0.00800432 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x264d83735b1cba13 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x264d83735b1cba13 Time: 0.0075609 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3e116db8858d0d41 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x3e116db8858d0d41 Time: 0.0059445 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x758f8b2079a95b2e [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x758f8b2079a95b2e Time: 0.00564958 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7de8ad674a85e82a [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x7de8ad674a85e82a Time: 0.00775868 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x8f07802f58d278c0 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x8f07802f58d278c0 Time: 0.0104758 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x1cfa820c55616892 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x1cfa820c55616892 Time: 0.00692963 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xccdb99df0646c7b3 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xccdb99df0646c7b3 Time: 0.00793095 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcf392eca056b8d88 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xcf392eca056b8d88 Time: 0.0102932 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x4f8662a723b489e1 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x4f8662a723b489e1 Time: 0.00791507 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x8e1dd2962c589dd4 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x8e1dd2962c589dd4 Time: 0.00592348 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xaba07efc49c11a6c [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xaba07efc49c11a6c Time: 0.0100742 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xd7985d83133bcf37 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xd7985d83133bcf37 Time: 0.00777768 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xb34706d47a62a016 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xb34706d47a62a016 Time: 0.00780728 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x8486adb55ae0ca6c [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x8486adb55ae0ca6c Time: 0.00686346 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x86d1488f426124e1 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x86d1488f426124e1 Time: 0.00752096 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcba01f45d37a76a0 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xcba01f45d37a76a0 Time: 0.00591287 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x62a338704beec449 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x62a338704beec449 Time: 0.0103517 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x68f52f0a3f1c5b56 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x68f52f0a3f1c5b56 Time: 0.0059125 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdb3ae212a7704d44 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xdb3ae212a7704d44 Time: 0.00832508 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x4e7f02f91ddf4673 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x4e7f02f91ddf4673 Time: 0.010674 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xaceaca2c82ab40f3 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xaceaca2c82ab40f3 Time: 0.00840928 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xaa30815cbd0f74b7 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xaa30815cbd0f74b7 Time: 0.0101946 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6c336d1b7c64ffa3 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x6c336d1b7c64ffa3 Time: 0.00572087 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb7a90e7097d64877 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xb7a90e7097d64877 Time: 0.00646976 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x682fae8be946411d [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x682fae8be946411d Time: 0.007184 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x70ffb5fe2e1321e3 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x70ffb5fe2e1321e3 Time: 0.00703238 [04/18/2023-18:35:18] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x27fb8661fea664b3 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x27fb8661fea664b3 Time: 0.00614286 [04/18/2023-18:35:18] [V] [TRT] Fastest Tactic: 0x758f8b2079a95b2e Time: 0.00564958 [04/18/2023-18:35:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x758f8b2079a95b2e [04/18/2023-18:35:18] [V] [TRT] =============== Computing costs for [04/18/2023-18:35:18] [V] [TRT] *************** Autotuning format combination: Int8(204800,400,20,1) -> Int8(204800,400,20,1) long-strided *************** [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:18] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] *************** Autotuning format combination: Int8(204800,400,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:18] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(51200,400:4,20,1) long-strided *************** [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:35:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:35:18] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:18] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(6400,400:32,20,1) long-strided *************** [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:18] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(12800,400:4,20,1) *************** [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:35:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:35:18] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:18] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:18] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Int8(6400,400:32,20,1) long-strided *************** [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:35:18] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:35:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:35:18] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:18] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00457929 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00448357 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00463469 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00489234 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00535602 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00475532 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00533266 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00551033 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00666971 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0068824 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00655356 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00698797 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0156407 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00696359 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00712599 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.0107115 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00480853 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.0107755 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.0105535 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0109238 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0158928 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00508563 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00460457 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0058997 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0074208 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0161798 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00784024 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00692615 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0120491 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0170179 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00688174 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00506168 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.0067973 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00455686 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0165653 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0163027 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0117057 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00710727 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00561917 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00528963 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0163505 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0160935 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0114753 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.0109967 [04/18/2023-18:35:18] [V] [TRT] Fastest Tactic: 0x90af0952ccc337b8 Time: 0.00448357 [04/18/2023-18:35:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x90af0952ccc337b8 [04/18/2023-18:35:18] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:35:18] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:35:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:35:18] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:18] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xeb1602207b0c3d49 Time: 0.00444551 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x90af0952ccc337b8 Time: 0.00447971 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00460977 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xb3e028693e71e990 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xb3e028693e71e990 Time: 0.00494928 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00534976 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00476754 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x4df7e35b8de312d7 Time: 0.00532013 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00551156 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x8aed0c9812ff1e34 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x8aed0c9812ff1e34 Time: 0.00666992 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00687848 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x25bf7139bbd93bc8 Time: 0.00655439 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0070104 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x14db55f2724dda9f [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x14db55f2724dda9f Time: 0.0156137 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x3321b9c38b0ba08d Time: 0.00679148 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x5e22a4cd8f7a7f29 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x5e22a4cd8f7a7f29 Time: 0.00715337 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x6d066fa755f280f9 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x6d066fa755f280f9 Time: 0.0107063 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xa40d21cb7ebb07bf Time: 0.00480152 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4ce54017654ce216 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x4ce54017654ce216 Time: 0.010737 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x15f0bde1f6cbbf61 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x15f0bde1f6cbbf61 Time: 0.0105221 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0108679 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x9ca4b256db721f9d [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x9ca4b256db721f9d Time: 0.0158683 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0779fa4ac8f9f2ee Time: 0.00507665 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x4862d9a1cd4ec818 Time: 0.00456114 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00588069 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.00742857 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0159898 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.00783495 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.00696316 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0121036 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0173755 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4a79db7911ff56ec [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x4a79db7911ff56ec Time: 0.00672312 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00507681 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x16bf68703cf6ee6c [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x16bf68703cf6ee6c Time: 0.00680403 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x6eb8c2607f51ccff Time: 0.00456829 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0165862 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0162804 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0117078 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.00719726 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00563182 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00531708 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xa767fa987290f29d [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xa767fa987290f29d Time: 0.0163022 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xd851a0a9f1b84453 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xd851a0a9f1b84453 Time: 0.0161036 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0115446 [04/18/2023-18:35:18] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0xf6d111860199beba [04/18/2023-18:35:18] [V] [TRT] Tactic: 0xf6d111860199beba Time: 0.0109832 [04/18/2023-18:35:18] [V] [TRT] Fastest Tactic: 0xeb1602207b0c3d49 Time: 0.00444551 [04/18/2023-18:35:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:35:18] [V] [TRT] =============== Computing costs for [04/18/2023-18:35:18] [V] [TRT] *************** Autotuning format combination: Int8(204800,400,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear + /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:18] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear + /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(12800,400:4,20,1) *************** [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear + /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:35:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear + /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:35:18] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear + /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:18] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear + /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear + /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:18] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear + /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-18:35:18] [V] [TRT] =============== Computing costs for [04/18/2023-18:35:18] [V] [TRT] *************** Autotuning format combination: Float(408000,1600,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00452443 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00377877 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0034818 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00378526 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00339678 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00334926 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00375631 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00333374 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00336882 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0032257 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0043574 [04/18/2023-18:35:18] [V] [TRT] Fastest Tactic: 0x0000000000000009 Time: 0.0032257 [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWise) [04/18/2023-18:35:18] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000009 [04/18/2023-18:35:18] [V] [TRT] *************** Autotuning format combination: Float(408000,1600,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00450971 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00378057 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00347146 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00368574 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00332249 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00300781 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00360549 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00316661 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00320315 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00318954 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00440187 [04/18/2023-18:35:18] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.00300781 [04/18/2023-18:35:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [04/18/2023-18:35:18] [V] [TRT] *************** Autotuning format combination: Float(408000,1,10200,255) -> Float(408000,1,10200,255) *************** [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.004524 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0037825 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00349469 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00377504 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00341137 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00333789 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00373158 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00334586 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00336489 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00323302 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00436959 [04/18/2023-18:35:18] [V] [TRT] Fastest Tactic: 0x0000000000000009 Time: 0.00323302 [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWise) [04/18/2023-18:35:18] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000009 [04/18/2023-18:35:18] [V] [TRT] *************** Autotuning format combination: Float(102400,1:4,2560,64) -> Float(102400,1:4,2560,64) *************** [04/18/2023-18:35:18] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00336882 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00344196 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00363703 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00351275 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00381137 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00424296 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00376217 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0042685 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00458886 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00570884 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00408699 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00384698 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00350595 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00388584 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00346166 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00359383 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00426783 [04/18/2023-18:35:18] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00378105 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00379633 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0042244 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00540918 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00461508 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00422763 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00420706 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0033987 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00404406 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00528016 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00336882 [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWise) [04/18/2023-18:35:19] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Float(12800,1600:32,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0038175 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00372466 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00427213 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00571959 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00380824 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x0000000000000019 Time: 0.00372466 [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWise) [04/18/2023-18:35:19] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000019 [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Float(12800,1600:32,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.003792 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00414002 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00523837 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00763092 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00378575 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00364149 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00408842 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00543373 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00365486 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00377396 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x0000000000000019 Time: 0.00364149 [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000019 [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Float(1:4,1600,40,1) -> Float(1:4,1600,40,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0218142 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0221329 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0220264 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.0218142 [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(408000,1600,40,1) -> Float(408000,1600,40,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00447814 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00379032 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0034919 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0037772 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00338052 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00334427 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0036861 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00328987 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00318049 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00317555 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00436558 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x0000000000000009 Time: 0.00317555 [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000009 [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(408000,1600,40,1) -> Half(408000,1600,40,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00450886 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00376505 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00346852 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0036691 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00330535 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00301467 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00361966 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00315737 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00301248 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00296247 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00437416 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x0000000000000009 Time: 0.00296247 [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWise) [04/18/2023-18:35:19] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000009 [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(204800,1600:2,40,1) -> Half(204800,1600:2,40,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00435906 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00391734 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00362434 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00369137 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0035355 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00321249 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00421876 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0036304 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00348201 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00360686 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0064479 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00512196 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00456543 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000000d Time: 0.004515 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00410057 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00359977 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00435075 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00372361 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00340571 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00333193 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00434452 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00632666 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.00321249 [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWise) [04/18/2023-18:35:19] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(51200,1:8,1280,32) -> Half(51200,1:8,1280,32) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00311046 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00318557 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00356371 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00328613 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00384289 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00347853 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00369055 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00447429 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00385732 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00437749 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00338754 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00353215 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00329112 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00402197 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00345317 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00323027 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00523984 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00403759 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00363474 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00353606 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0040579 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0038234 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00370473 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00444661 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00543069 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0046953 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00437652 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00428249 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00308853 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00349119 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00405702 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0053699 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00308853 [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWise) [04/18/2023-18:35:19] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(25600,1:16,640,16) -> Half(25600,1:16,640,16) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00328706 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0036552 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00355958 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00464265 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00394106 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00350606 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00654732 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00468571 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00397701 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00441628 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00345687 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00347788 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00402628 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00523559 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00407352 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00382412 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00369243 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00445257 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00323667 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00336797 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00404508 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.00323667 [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWise) [04/18/2023-18:35:19] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(12800,1600:32,40,1) -> Float(12800,1600:32,40,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00380451 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00394452 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00398171 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00493683 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00379332 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00379332 [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(12800,1600:32,40,1) -> Half(12800,1600:32,40,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00339221 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00360709 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00419814 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00563868 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00362103 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00353572 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00363714 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00451629 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00337648 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0035992 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.00337648 [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWise) [04/18/2023-18:35:19] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(1:8,1600,40,1) -> Half(1:8,1600,40,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001c Time: 0.026051 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0227213 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001e Time: 0.022718 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0318327 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.022718 [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(408000:32,1600,40,1) -> Half(408000:32,1600,40,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_1) (PointWiseV2) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0963794 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0963291 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0961829 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0999406 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0834743 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0849189 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0854309 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0861623 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001e Time: 0.095744 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0832549 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.0832549 [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-18:35:19] [V] [TRT] =============== Computing costs for [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Float(408000,1600,40,1) -> Float(408000,136000,3400,85,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_2 + /model.77/Transpose_1 (Shuffle) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00801168 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0132663 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00801168 [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Float(408000,1,10200,255) -> Float(408000,136000,1,3400,40) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_2 + /model.77/Transpose_1 (Shuffle) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0219363 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0136906 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0136906 [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Float(102400,1:4,2560,64) -> Float(102000,34000,1:4,850,10) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_2 + /model.77/Transpose_1 (Shuffle) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0217202 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0165953 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0165953 [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Float(12800,1600:32,40,1) -> Float(20400,6800,3400:32,85,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_2 + /model.77/Transpose_1 (Shuffle) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0544183 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0156261 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0156261 [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(408000,1600,40,1) -> Half(408000,136000,3400,85,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_2 + /model.77/Transpose_1 (Shuffle) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00724091 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0188874 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00724091 [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(204800,1600:2,40,1) -> Half(204000,68000,3400:2,85,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_2 + /model.77/Transpose_1 (Shuffle) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00774617 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0268678 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00774617 [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(102400,1:4,2560,64) -> Half(102000,34000,1:4,850,10) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_2 + /model.77/Transpose_1 (Shuffle) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0211729 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0206054 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0206054 [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(51200,1:8,1280,32) -> Half(51000,17000,1:8,425,5) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_2 + /model.77/Transpose_1 (Shuffle) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0212238 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0159055 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0159055 [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(25600,1:16,640,16) -> Half(30600,10200,1:16,255,3) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_2 + /model.77/Transpose_1 (Shuffle) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0270042 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0162778 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0162778 [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(12800,1600:32,40,1) -> Half(20400,6800,3400:32,85,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_2 + /model.77/Transpose_1 (Shuffle) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0266034 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.017504 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.017504 [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:35:19] [V] [TRT] =============== Computing costs for [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Float(408000,136000,3400,85,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Split_1 (Slice) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243192 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00243192 [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Split_1 (Padding) [04/18/2023-18:35:19] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(408000,136000,3400,85,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Split_1 (Slice) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00236118 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00236118 [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Split_1 (Padding) [04/18/2023-18:35:19] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(204000,68000,3400:2,85,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Split_1 (Padding) [04/18/2023-18:35:19] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(51000,17000,1:8,425,5) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Split_1 (Padding) [04/18/2023-18:35:19] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] =============== Computing costs for [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Float(408000,136000,3400,85,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_116 (Slice) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239916 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239916 [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_116 (Padding) [04/18/2023-18:35:19] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(408000,136000,3400,85,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_116 (Slice) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0023689 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0023689 [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_116 (Padding) [04/18/2023-18:35:19] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(204000,68000,3400:2,85,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_116 (Padding) [04/18/2023-18:35:19] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(51000,17000,1:8,425,5) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_116 (Padding) [04/18/2023-18:35:19] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] =============== Computing costs for [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Float(408000,136000,3400,85,1) -> Float(408000,136000,3400,85,1) long-strided *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_117 (Slice) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00442417 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00442417 [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_117 (Padding) [04/18/2023-18:35:19] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Float(408000,136000,3400,85,1) -> Float(388800,129600,3240,81,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_117 (Slice) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00442362 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00442362 [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_117 (Padding) [04/18/2023-18:35:19] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(408000,136000,3400,85,1) -> Half(408000,136000,3400,85,1) long-strided *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_117 (Slice) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00440589 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00440589 [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_117 (Padding) [04/18/2023-18:35:19] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(408000,136000,3400,85,1) -> Half(388800,129600,3240,81,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_117 (Slice) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00440977 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00440977 [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_117 (Padding) [04/18/2023-18:35:19] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(204000,68000,3400:2,85,1) -> Half(204000,68000,3400:2,85,1) long-strided *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_117 (Padding) [04/18/2023-18:35:19] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(204000,68000,3400:2,85,1) -> Half(194400,64800,3240:2,81,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_117 (Padding) [04/18/2023-18:35:19] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(51000,17000,1:8,425,5) -> Half(51000,17000,1:8,425,5) long-strided *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_117 (Padding) [04/18/2023-18:35:19] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Half(51000,17000,1:8,425,5) -> Half(48600,16200,1:8,405,5) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: /model.77/Split_1_117 (Padding) [04/18/2023-18:35:19] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] =============== Computing costs for [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Int8(51200,400,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:19] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:19] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Int8(12800,400:4,20,1) -> Int8(12800,400:4,20,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:35:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:35:19] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:19] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:19] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Int8(12800,400:4,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:19] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:19] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Int8(1600,400:32,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:35:19] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:35:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:35:19] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:19] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.00569371 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00587886 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.00712925 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.00581595 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.006128 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.0069821 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00727748 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-18:35:19] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.00925743 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00937143 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00992427 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0165206 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-18:35:19] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.00951286 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-18:35:19] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.00964937 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.016578 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0273851 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.00900571 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0105447 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0270385 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0272792 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:35:19] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0119699 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0105724 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0190749 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0277509 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.0066988 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.00700321 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0280869 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0278027 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0181371 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0107115 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00786165 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00738743 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0171652 [04/18/2023-18:35:19] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0165313 [04/18/2023-18:35:19] [V] [TRT] Fastest Tactic: 0x7ddd3b3f55023bab Time: 0.00569371 [04/18/2023-18:35:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x7ddd3b3f55023bab [04/18/2023-18:35:19] [V] [TRT] =============== Computing costs for [04/18/2023-18:35:19] [V] [TRT] *************** Autotuning format combination: Float(9600,3200,80,2,1), Float(3200,3200,80,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:35:19] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-18:35:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00235174 [04/18/2023-18:35:20] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00251782 [04/18/2023-18:35:20] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00238255 [04/18/2023-18:35:20] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00283294 [04/18/2023-18:35:20] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00273466 [04/18/2023-18:35:20] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00248772 [04/18/2023-18:35:20] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00349391 [04/18/2023-18:35:21] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00300381 [04/18/2023-18:35:21] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00277917 [04/18/2023-18:35:21] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00297451 [04/18/2023-18:35:21] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00269878 [04/18/2023-18:35:21] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00235174 [04/18/2023-18:35:21] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWise) [04/18/2023-18:35:21] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 [04/18/2023-18:35:21] [V] [TRT] *************** Autotuning format combination: Float(9600,3200,80,2,1), Float(3200,3200,80,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:35:21] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-18:35:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00274044 [04/18/2023-18:35:21] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00271491 [04/18/2023-18:35:22] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00376493 [04/18/2023-18:35:22] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00314892 [04/18/2023-18:35:22] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00290331 [04/18/2023-18:35:22] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00273087 [04/18/2023-18:35:22] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00433039 [04/18/2023-18:35:23] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00334288 [04/18/2023-18:35:23] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00308279 [04/18/2023-18:35:23] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00294932 [04/18/2023-18:35:23] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00253466 [04/18/2023-18:35:23] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00253466 [04/18/2023-18:35:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:35:23] [V] [TRT] *************** Autotuning format combination: Float(9600,3200,1,80,40), Float(3200,3200,1,80,40) -> Float(9600,3200,1,80,40) *************** [04/18/2023-18:35:23] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-18:35:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00248008 [04/18/2023-18:35:23] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00266701 [04/18/2023-18:35:23] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00248339 [04/18/2023-18:35:23] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00301381 [04/18/2023-18:35:23] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00287899 [04/18/2023-18:35:23] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00266413 [04/18/2023-18:35:23] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0038394 [04/18/2023-18:35:23] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00318283 [04/18/2023-18:35:23] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00284173 [04/18/2023-18:35:23] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00288823 [04/18/2023-18:35:23] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00249584 [04/18/2023-18:35:23] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00248008 [04/18/2023-18:35:23] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWise) [04/18/2023-18:35:23] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 [04/18/2023-18:35:23] [V] [TRT] *************** Autotuning format combination: Float(2400,800,1:4,20,10), Float(800,800,1:4,20,10) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-18:35:23] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-18:35:23] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00296285 [04/18/2023-18:35:23] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00308581 [04/18/2023-18:35:24] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00379092 [04/18/2023-18:35:24] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00375291 [04/18/2023-18:35:24] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00369981 [04/18/2023-18:35:24] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00367039 [04/18/2023-18:35:24] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00505096 [04/18/2023-18:35:25] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00484419 [04/18/2023-18:35:25] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00484206 [04/18/2023-18:35:25] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00509415 [04/18/2023-18:35:25] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00270051 [04/18/2023-18:35:25] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00294148 [04/18/2023-18:35:25] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00294157 [04/18/2023-18:35:26] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00341888 [04/18/2023-18:35:26] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00358492 [04/18/2023-18:35:26] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00392204 [04/18/2023-18:35:26] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00429943 [04/18/2023-18:35:26] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00471993 [04/18/2023-18:35:27] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0050601 [04/18/2023-18:35:27] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00611314 [04/18/2023-18:35:27] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00259965 [04/18/2023-18:35:27] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00285998 [04/18/2023-18:35:27] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0031201 [04/18/2023-18:35:27] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00388584 [04/18/2023-18:35:28] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00276413 [04/18/2023-18:35:28] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00266362 [04/18/2023-18:35:28] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00263032 [04/18/2023-18:35:28] [V] [TRT] Fastest Tactic: 0x0000000000000014 Time: 0.00259965 [04/18/2023-18:35:28] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWise) [04/18/2023-18:35:28] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000014 [04/18/2023-18:35:28] [V] [TRT] *************** Autotuning format combination: Float(480,160,80:32,2,1), Float(160,160,80:32,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-18:35:28] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-18:35:28] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00286382 [04/18/2023-18:35:28] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00382809 [04/18/2023-18:35:28] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0051409 [04/18/2023-18:35:29] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00746606 [04/18/2023-18:35:29] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00291227 [04/18/2023-18:35:29] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.00286382 [04/18/2023-18:35:29] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWise) [04/18/2023-18:35:29] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-18:35:29] [V] [TRT] *************** Autotuning format combination: Float(480,160,80:32,2,1), Float(160,160,80:32,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-18:35:29] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-18:35:29] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00350383 [04/18/2023-18:35:29] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00550066 [04/18/2023-18:35:29] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00827962 [04/18/2023-18:35:30] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0142562 [04/18/2023-18:35:30] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00289006 [04/18/2023-18:35:30] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00351822 [04/18/2023-18:35:30] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00452657 [04/18/2023-18:35:30] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00690024 [04/18/2023-18:35:31] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0033836 [04/18/2023-18:35:31] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00292021 [04/18/2023-18:35:31] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.00289006 [04/18/2023-18:35:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-18:35:31] [V] [TRT] *************** Autotuning format combination: Float(3200,1:4,80,2,1), Float(3200,1:4,80,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:35:31] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-18:35:31] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00281358 [04/18/2023-18:35:31] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00273363 [04/18/2023-18:35:31] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00270448 [04/18/2023-18:35:31] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.00270448 [04/18/2023-18:35:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [04/18/2023-18:35:31] [V] [TRT] *************** Autotuning format combination: Half(9600,3200,80,2,1), Half(3200,3200,80,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:35:31] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-18:35:31] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00260314 [04/18/2023-18:35:32] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00284917 [04/18/2023-18:35:32] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00267742 [04/18/2023-18:35:32] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0030826 [04/18/2023-18:35:32] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00291273 [04/18/2023-18:35:32] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00269671 [04/18/2023-18:35:32] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00388732 [04/18/2023-18:35:33] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00335692 [04/18/2023-18:35:33] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00303143 [04/18/2023-18:35:33] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00287762 [04/18/2023-18:35:33] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00256221 [04/18/2023-18:35:33] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00256221 [04/18/2023-18:35:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:35:33] [V] [TRT] *************** Autotuning format combination: Half(9600,3200,80,2,1), Half(3200,3200,80,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:35:33] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-18:35:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00280318 [04/18/2023-18:35:33] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00281878 [04/18/2023-18:35:34] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00267005 [04/18/2023-18:35:34] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00315518 [04/18/2023-18:35:34] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00297876 [04/18/2023-18:35:34] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00272975 [04/18/2023-18:35:34] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00397917 [04/18/2023-18:35:34] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00338062 [04/18/2023-18:35:35] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00315627 [04/18/2023-18:35:35] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00291872 [04/18/2023-18:35:35] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00261494 [04/18/2023-18:35:35] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00261494 [04/18/2023-18:35:35] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWise) [04/18/2023-18:35:35] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:35:35] [V] [TRT] *************** Autotuning format combination: Half(4800,1600,80:2,2,1), Half(1600,1600,80:2,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-18:35:35] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-18:35:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00262791 [04/18/2023-18:35:35] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00288165 [04/18/2023-18:35:35] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00290222 [04/18/2023-18:35:36] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00345589 [04/18/2023-18:35:36] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00344065 [04/18/2023-18:35:36] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0033229 [04/18/2023-18:35:36] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00434258 [04/18/2023-18:35:36] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00435823 [04/18/2023-18:35:37] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00437971 [04/18/2023-18:35:37] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00449143 [04/18/2023-18:35:37] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00283016 [04/18/2023-18:35:37] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00289691 [04/18/2023-18:35:37] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00273699 [04/18/2023-18:35:37] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00318994 [04/18/2023-18:35:38] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00297068 [04/18/2023-18:35:38] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00290962 [04/18/2023-18:35:38] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00407517 [04/18/2023-18:35:38] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00357932 [04/18/2023-18:35:38] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00329995 [04/18/2023-18:35:38] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00311344 [04/18/2023-18:35:39] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00265016 [04/18/2023-18:35:39] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00276404 [04/18/2023-18:35:39] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00262791 [04/18/2023-18:35:39] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWise) [04/18/2023-18:35:39] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 [04/18/2023-18:35:39] [V] [TRT] *************** Autotuning format combination: Half(1200,400,1:8,10,5), Half(400,400,1:8,10,5) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-18:35:39] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-18:35:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0027181 [04/18/2023-18:35:39] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00305167 [04/18/2023-18:35:39] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00334437 [04/18/2023-18:35:40] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00381582 [04/18/2023-18:35:40] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00434743 [04/18/2023-18:35:40] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00417006 [04/18/2023-18:35:40] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00501454 [04/18/2023-18:35:40] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0062555 [04/18/2023-18:35:41] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00600724 [04/18/2023-18:35:41] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00603676 [04/18/2023-18:35:41] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00263464 [04/18/2023-18:35:41] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00305945 [04/18/2023-18:35:41] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00314315 [04/18/2023-18:35:42] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00356627 [04/18/2023-18:35:42] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00377576 [04/18/2023-18:35:42] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00370966 [04/18/2023-18:35:42] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0049362 [04/18/2023-18:35:42] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00503172 [04/18/2023-18:35:43] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00523004 [04/18/2023-18:35:43] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00521796 [04/18/2023-18:35:43] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00268233 [04/18/2023-18:35:43] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00295557 [04/18/2023-18:35:43] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00350339 [04/18/2023-18:35:44] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00453929 [04/18/2023-18:35:44] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0032298 [04/18/2023-18:35:44] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0028515 [04/18/2023-18:35:44] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00323383 [04/18/2023-18:35:44] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00404622 [04/18/2023-18:35:44] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00270275 [04/18/2023-18:35:45] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00261187 [04/18/2023-18:35:45] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00271086 [04/18/2023-18:35:45] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00263871 [04/18/2023-18:35:45] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.00261187 [04/18/2023-18:35:45] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWise) [04/18/2023-18:35:45] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [04/18/2023-18:35:45] [V] [TRT] *************** Autotuning format combination: Half(720,240,1:16,6,3), Half(240,240,1:16,6,3) -> Half(720,240,1:16,6,3) *************** [04/18/2023-18:35:45] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-18:35:45] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00292021 [04/18/2023-18:35:45] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00328457 [04/18/2023-18:35:46] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00344642 [04/18/2023-18:35:46] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00356003 [04/18/2023-18:35:46] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00375654 [04/18/2023-18:35:46] [V] [TRT] Tactic: 0x000000000000000f Time: 0.003365 [04/18/2023-18:35:46] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00438885 [04/18/2023-18:35:47] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00422911 [04/18/2023-18:35:47] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00373861 [04/18/2023-18:35:47] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00363074 [04/18/2023-18:35:47] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00287369 [04/18/2023-18:35:47] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00294754 [04/18/2023-18:35:48] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00327501 [04/18/2023-18:35:48] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00369887 [04/18/2023-18:35:48] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00296219 [04/18/2023-18:35:48] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00333852 [04/18/2023-18:35:48] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00342868 [04/18/2023-18:35:49] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0037338 [04/18/2023-18:35:49] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00303876 [04/18/2023-18:35:49] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00325579 [04/18/2023-18:35:49] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00316949 [04/18/2023-18:35:49] [V] [TRT] Fastest Tactic: 0x0000000000000014 Time: 0.00287369 [04/18/2023-18:35:49] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWise) [04/18/2023-18:35:49] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000014 [04/18/2023-18:35:49] [V] [TRT] *************** Autotuning format combination: Half(480,160,80:32,2,1), Half(160,160,80:32,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-18:35:49] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-18:35:49] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00322062 [04/18/2023-18:35:49] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00340691 [04/18/2023-18:35:50] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0035239 [04/18/2023-18:35:50] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00460114 [04/18/2023-18:35:50] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00302524 [04/18/2023-18:35:50] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00302524 [04/18/2023-18:35:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-18:35:50] [V] [TRT] *************** Autotuning format combination: Half(480,160,80:32,2,1), Half(160,160,80:32,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-18:35:50] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-18:35:50] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00306986 [04/18/2023-18:35:50] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00364617 [04/18/2023-18:35:51] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00466477 [04/18/2023-18:35:51] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00697469 [04/18/2023-18:35:51] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0032908 [04/18/2023-18:35:51] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00341594 [04/18/2023-18:35:51] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00367391 [04/18/2023-18:35:51] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00490499 [04/18/2023-18:35:52] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00296518 [04/18/2023-18:35:52] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00329309 [04/18/2023-18:35:52] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.00296518 [04/18/2023-18:35:52] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWise) [04/18/2023-18:35:52] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [04/18/2023-18:35:52] [V] [TRT] *************** Autotuning format combination: Half(3200,1:8,80,2,1), Half(3200,1:8,80,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:35:52] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-18:35:52] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00334937 [04/18/2023-18:35:52] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00330036 [04/18/2023-18:35:52] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00303352 [04/18/2023-18:35:53] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00291739 [04/18/2023-18:35:53] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00291739 [04/18/2023-18:35:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-18:35:53] [V] [TRT] *************** Autotuning format combination: Half(3200,3200:32,80,2,1), Half(3200,3200:32,80,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:35:53] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) (PointWiseV2) [04/18/2023-18:35:53] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00345196 [04/18/2023-18:35:53] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00383531 [04/18/2023-18:35:53] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00499468 [04/18/2023-18:35:53] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00720686 [04/18/2023-18:35:54] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00324706 [04/18/2023-18:35:54] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00365074 [04/18/2023-18:35:54] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00427657 [04/18/2023-18:35:54] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00600819 [04/18/2023-18:35:54] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00362594 [04/18/2023-18:35:54] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00334193 [04/18/2023-18:35:54] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.00324706 [04/18/2023-18:35:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-18:35:54] [V] [TRT] =============== Computing costs for [04/18/2023-18:35:54] [V] [TRT] *************** Autotuning format combination: Float(9600,3200,80,2,1), Float(6,2,2,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:35:54] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-18:35:54] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00471742 [04/18/2023-18:35:54] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0051311 [04/18/2023-18:35:54] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00479558 [04/18/2023-18:35:54] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00562585 [04/18/2023-18:35:54] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00575707 [04/18/2023-18:35:54] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0050292 [04/18/2023-18:35:54] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00635309 [04/18/2023-18:35:54] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00650535 [04/18/2023-18:35:54] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00649043 [04/18/2023-18:35:54] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00605695 [04/18/2023-18:35:54] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00283509 [04/18/2023-18:35:54] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00283509 [04/18/2023-18:35:54] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWise) [04/18/2023-18:35:54] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:35:54] [V] [TRT] *************** Autotuning format combination: Float(9600,3200,80,2,1), Float(6,2,2,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:35:54] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-18:35:54] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00451743 [04/18/2023-18:35:54] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0050456 [04/18/2023-18:35:54] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00490118 [04/18/2023-18:35:54] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00554321 [04/18/2023-18:35:54] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00583625 [04/18/2023-18:35:54] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00505679 [04/18/2023-18:35:54] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00650971 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00690917 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00650826 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0059941 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00273734 [04/18/2023-18:35:55] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00273734 [04/18/2023-18:35:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:35:55] [V] [TRT] *************** Autotuning format combination: Float(9600,3200,1,80,40), Float(6,2,1,2,1) -> Float(9600,3200,1,80,40) *************** [04/18/2023-18:35:55] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00280955 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00287826 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00283984 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00304253 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00288201 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0028949 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00302476 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00287067 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00287579 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00283689 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00277908 [04/18/2023-18:35:55] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00277908 [04/18/2023-18:35:55] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWise) [04/18/2023-18:35:55] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:35:55] [V] [TRT] *************** Autotuning format combination: Float(2400,800,1:4,20,10), Float(6,2,1:4,2,1) -> Float(2400,800,1:4,20,10) *************** [04/18/2023-18:35:55] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00289655 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00289929 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00329756 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00302076 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00302848 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00298524 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0033066 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00332991 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0031198 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00314951 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00285508 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00286409 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00285311 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00287588 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00296872 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00299876 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00301524 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00317545 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00322174 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00344555 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00262093 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0027949 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00293626 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00307929 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00279648 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00266785 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00251116 [04/18/2023-18:35:55] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.00251116 [04/18/2023-18:35:55] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWise) [04/18/2023-18:35:55] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [04/18/2023-18:35:55] [V] [TRT] *************** Autotuning format combination: Float(480,160,80:32,2,1), Float(6,2,2:32,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-18:35:55] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00294139 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0031872 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00335787 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00372489 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00284666 [04/18/2023-18:35:55] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00284666 [04/18/2023-18:35:55] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWise) [04/18/2023-18:35:55] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-18:35:55] [V] [TRT] *************** Autotuning format combination: Float(480,160,80:32,2,1), Float(6,2,2:32,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-18:35:55] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00317633 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00440713 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00463867 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00521159 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00270077 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00291383 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00310857 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00349179 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00313471 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00269732 [04/18/2023-18:35:55] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00269732 [04/18/2023-18:35:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-18:35:55] [V] [TRT] *************** Autotuning format combination: Float(3200,1:4,80,2,1), Float(2,1:4,2,2,1) -> Float(3200,1:4,80,2,1) *************** [04/18/2023-18:35:55] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00269096 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0025787 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00257445 [04/18/2023-18:35:55] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.00257445 [04/18/2023-18:35:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [04/18/2023-18:35:55] [V] [TRT] *************** Autotuning format combination: Half(9600,3200,80,2,1), Half(6,2,2,2,1) -> Float(9600,3200,80,2,1) *************** [04/18/2023-18:35:55] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00432511 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00492816 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00458271 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00539462 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00555886 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00478598 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00634196 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00656187 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00617638 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00573148 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00245532 [04/18/2023-18:35:55] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00245532 [04/18/2023-18:35:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:35:55] [V] [TRT] *************** Autotuning format combination: Half(9600,3200,80,2,1), Half(6,2,2,2,1) -> Half(9600,3200,80,2,1) *************** [04/18/2023-18:35:55] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00432296 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00491642 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00464 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00545134 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00554145 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00489173 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00637356 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00647235 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.006208 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00570268 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0024475 [04/18/2023-18:35:55] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.0024475 [04/18/2023-18:35:55] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWise) [04/18/2023-18:35:55] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:35:55] [V] [TRT] *************** Autotuning format combination: Half(4800,1600,80:2,2,1), Half(6,2,2:2,2,1) -> Half(4800,1600,80:2,2,1) *************** [04/18/2023-18:35:55] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00366023 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00398362 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00381365 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00436904 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00428302 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00382689 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00526449 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00468911 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00431113 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00400749 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00342204 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00381317 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00350551 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00424618 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00398247 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00348978 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00522514 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00459972 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00415007 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00364149 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00267623 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00254701 [04/18/2023-18:35:55] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.00254701 [04/18/2023-18:35:55] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWise) [04/18/2023-18:35:55] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [04/18/2023-18:35:55] [V] [TRT] *************** Autotuning format combination: Half(1200,400,1:8,10,5), Half(6,2,1:8,2,1) -> Half(1200,400,1:8,10,5) *************** [04/18/2023-18:35:55] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00288357 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00301124 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00317505 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00316949 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00335979 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00329517 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00351866 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00380199 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00363714 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00349603 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00276791 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00275517 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00270836 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00285114 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00286245 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000000f Time: 0.002829 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00316164 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00313848 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00301162 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00299229 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00253602 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00264567 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00283258 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00311294 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00240427 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00242232 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00255878 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00285311 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00269861 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00257045 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00254292 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00240541 [04/18/2023-18:35:55] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.00240427 [04/18/2023-18:35:55] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWise) [04/18/2023-18:35:55] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-18:35:55] [V] [TRT] *************** Autotuning format combination: Half(720,240,1:16,6,3), Half(6,2,1:16,2,1) -> Half(720,240,1:16,6,3) *************** [04/18/2023-18:35:55] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00273639 [04/18/2023-18:35:55] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00315707 [04/18/2023-18:35:56] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00307064 [04/18/2023-18:35:56] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00362731 [04/18/2023-18:35:56] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00347037 [04/18/2023-18:35:56] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00319553 [04/18/2023-18:35:56] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00466699 [04/18/2023-18:35:57] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00388423 [04/18/2023-18:35:57] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00387842 [04/18/2023-18:35:57] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00377432 [04/18/2023-18:35:57] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00292226 [04/18/2023-18:35:58] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00317927 [04/18/2023-18:35:58] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00335362 [04/18/2023-18:35:58] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00381065 [04/18/2023-18:35:58] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00294997 [04/18/2023-18:35:58] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00312268 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00317643 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00353639 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00288292 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00280569 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00276334 [04/18/2023-18:35:59] [V] [TRT] Fastest Tactic: 0x000000000000000a Time: 0.00273639 [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWise) [04/18/2023-18:35:59] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000000a [04/18/2023-18:35:59] [V] [TRT] *************** Autotuning format combination: Half(480,160,80:32,2,1), Half(6,2,2:32,2,1) -> Float(480,160,80:32,2,1) *************** [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00282963 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00292469 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00309359 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00340637 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00281026 [04/18/2023-18:35:59] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00281026 [04/18/2023-18:35:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-18:35:59] [V] [TRT] *************** Autotuning format combination: Half(480,160,80:32,2,1), Half(6,2,2:32,2,1) -> Half(480,160,80:32,2,1) *************** [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00287095 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00335298 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00385299 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00501407 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00283509 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00299105 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00319736 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00366418 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00285356 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00281071 [04/18/2023-18:35:59] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00281071 [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWise) [04/18/2023-18:35:59] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:35:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-18:35:59] [V] [TRT] *************** Autotuning format combination: Half(3200,1:8,80,2,1), Half(2,1:8,2,2,1) -> Half(3200,1:8,80,2,1) *************** [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00283886 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00281824 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00283169 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00301571 [04/18/2023-18:35:59] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.00281824 [04/18/2023-18:35:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [04/18/2023-18:35:59] [V] [TRT] *************** Autotuning format combination: Half(3200,3200:32,80,2,1), Half(2,2:32,2,2,1) -> Half(3200,3200:32,80,2,1) *************** [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) (PointWiseV2) [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00437209 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00544609 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00720274 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0106664 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00382532 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00426595 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00518416 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00692724 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00326421 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00329673 [04/18/2023-18:35:59] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.00326421 [04/18/2023-18:35:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [04/18/2023-18:35:59] [V] [TRT] =============== Computing costs for [04/18/2023-18:35:59] [V] [TRT] *************** Autotuning format combination: Float(408000,136000,3400,85,1) -> Float(408000,85,1) *************** [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3 (Shuffle) [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00582016 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0121036 [04/18/2023-18:35:59] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00582016 [04/18/2023-18:35:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-18:35:59] [V] [TRT] *************** Autotuning format combination: Float(408000,136000,1,3400,40) -> Float(1,85,1) *************** [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3 (Shuffle) [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00921571 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.275602 [04/18/2023-18:35:59] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00921571 [04/18/2023-18:35:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-18:35:59] [V] [TRT] *************** Autotuning format combination: Float(102000,34000,1:4,850,10) -> Float(1:4,85,1) *************** [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3 (Shuffle) [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.215333 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0426069 [04/18/2023-18:35:59] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0426069 [04/18/2023-18:35:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:35:59] [V] [TRT] *************** Autotuning format combination: Float(20400,6800,3400:32,85,1) -> Float(408000:32,85,1) *************** [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3 (Shuffle) [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000000 Time: 2.05442 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.17803 [04/18/2023-18:35:59] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.17803 [04/18/2023-18:35:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:35:59] [V] [TRT] *************** Autotuning format combination: Half(408000,136000,3400,85,1) -> Half(408000,85,1) *************** [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3 (Shuffle) [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0030099 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.015243 [04/18/2023-18:35:59] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0030099 [04/18/2023-18:35:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-18:35:59] [V] [TRT] *************** Autotuning format combination: Half(204000,68000,3400:2,85,1) -> Half(408000:2,85,1) *************** [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3 (Shuffle) [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.055104 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0201309 [04/18/2023-18:35:59] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0201309 [04/18/2023-18:35:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:35:59] [V] [TRT] *************** Autotuning format combination: Half(102000,34000,1:4,850,10) -> Half(1:4,85,1) *************** [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3 (Shuffle) [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.116795 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0613242 [04/18/2023-18:35:59] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0613242 [04/18/2023-18:35:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:35:59] [V] [TRT] *************** Autotuning format combination: Half(51000,17000,1:8,425,5) -> Half(1:8,85,1) *************** [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3 (Shuffle) [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.244457 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0433406 [04/18/2023-18:35:59] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0433406 [04/18/2023-18:35:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:35:59] [V] [TRT] *************** Autotuning format combination: Half(30600,10200,1:16,255,3) -> Half(1:16,85,1) *************** [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3 (Shuffle) [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.501467 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0623177 [04/18/2023-18:35:59] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0623177 [04/18/2023-18:35:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:35:59] [V] [TRT] *************** Autotuning format combination: Half(20400,6800,3400:32,85,1) -> Half(408000:32,85,1) *************** [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_3 (Shuffle) [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000000 Time: 1.09568 [04/18/2023-18:35:59] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0578469 [04/18/2023-18:35:59] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0578469 [04/18/2023-18:35:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:35:59] [V] [TRT] =============== Computing costs for [04/18/2023-18:35:59] [V] [TRT] *************** Autotuning format combination: Int8(51200,400,20,1) -> Int8(204800,400,20,1) long-strided *************** [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:59] [V] [TRT] *************** Autotuning format combination: Int8(51200,400,20,1) -> Int8(51200,400,20,1) *************** [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:59] [V] [TRT] *************** Autotuning format combination: Int8(12800,400:4,20,1) -> Int8(51200,400:4,20,1) long-strided *************** [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:35:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:35:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:59] [V] [TRT] *************** Autotuning format combination: Int8(12800,400:4,20,1) -> Int8(6400,400:32,20,1) long-strided *************** [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:59] [V] [TRT] *************** Autotuning format combination: Int8(12800,400:4,20,1) -> Int8(12800,400:4,20,1) *************** [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:35:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:35:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:59] [V] [TRT] *************** Autotuning format combination: Int8(12800,400:4,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:35:59] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:35:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:35:59] [V] [TRT] *************** Autotuning format combination: Int8(1600,400:32,20,1) -> Int8(6400,400:32,20,1) long-strided *************** [04/18/2023-18:35:59] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:35:59] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:36:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:36:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:36:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.00568756 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.00587922 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0071434 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.00580133 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.00612 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.00701214 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.00729737 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.009224 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.00942229 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.00981303 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.016351 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.00944 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.00966491 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0165978 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0273272 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0085725 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0105414 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0270446 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.0272328 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0119813 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0104271 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0190697 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0277143 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.00660634 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0070006 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.028096 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0278187 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.0181703 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0107246 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.00786262 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.00737257 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0171987 [04/18/2023-18:36:00] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.0165887 [04/18/2023-18:36:00] [V] [TRT] Fastest Tactic: 0x7ddd3b3f55023bab Time: 0.00568756 [04/18/2023-18:36:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x7ddd3b3f55023bab [04/18/2023-18:36:00] [V] [TRT] *************** Autotuning format combination: Int8(1600,400:32,20,1) -> Int8(1600,400:32,20,1) *************** [04/18/2023-18:36:00] [V] [TRT] =============== Computing costs for [04/18/2023-18:36:00] [V] [TRT] *************** Autotuning format combination: Int8(204800,400,20,1) -> Int8(102400,400,20,1) *************** [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear + /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:36:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear + /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:36:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(25600,400:4,20,1) *************** [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear + /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:36:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear + /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:36:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear + /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:36:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear + /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:36:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear + /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:36:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear + /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:36:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Int8(3200,400:32,20,1) *************** [04/18/2023-18:36:00] [V] [TRT] =============== Computing costs for [04/18/2023-18:36:00] [V] [TRT] *************** Autotuning format combination: Int8(102400,400,20,1) -> Int8(204800,400,20,1) *************** [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:36:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:36:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(51200,400:4,20,1) *************** [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:36:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:36:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:36:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:36:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] *************** Autotuning format combination: Int8(25600,400:4,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:36:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:36:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] *************** Autotuning format combination: Int8(3200,400:32,20,1) -> Int8(6400,400:32,20,1) *************** [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) (CudaGroupConvolution) [04/18/2023-18:36:00] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) (CudaDepthwiseConvolution) [04/18/2023-18:36:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) (FusedConvActConvolution) [04/18/2023-18:36:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) (CaskFlattenConvolution) [04/18/2023-18:36:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) (CaskConvolution) [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x7ddd3b3f55023bab Time: 0.0130726 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x4bb804b3b091b301 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x4bb804b3b091b301 Time: 0.0131225 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x2a8d3d5ae3647db4 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x2a8d3d5ae3647db4 Time: 0.0112176 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x83caf00de690c0ec Time: 0.0123272 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xd8559956fb70c5c0 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xd8559956fb70c5c0 Time: 0.0127147 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xa085d13614221ec4 Time: 0.0105802 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xb960a0bfa8850b75 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xb960a0bfa8850b75 Time: 0.0110031 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa70be914883e5aff [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xa70be914883e5aff Time: 0.0143694 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x98744862ba458d9a [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x98744862ba458d9a Time: 0.0144983 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x459509ec55322f60 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x459509ec55322f60 Time: 0.0148183 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa197727afc8dee05 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xa197727afc8dee05 Time: 0.0262004 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xfbcd5a1da537e27f Time: 0.0145778 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xb35096a016bb733a Time: 0.0151141 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xe8c4479eeddac419 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xe8c4479eeddac419 Time: 0.0265021 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x4a15c8f5eb51fe8e [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x4a15c8f5eb51fe8e Time: 0.0470526 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x3f084feb7c0e1257 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x3f084feb7c0e1257 Time: 0.0132663 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xd7c8759ddafac114 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xd7c8759ddafac114 Time: 0.0161813 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x71d6803b42b3138e [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x71d6803b42b3138e Time: 0.0469589 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x7a6e06a0138186b0 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x7a6e06a0138186b0 Time: 0.047104 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0xc69ab4295ea0103e [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xc69ab4295ea0103e Time: 0.0191817 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x892689d63e1f5cb0 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x892689d63e1f5cb0 Time: 0.0164663 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x9b90c142f7ba1756 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x9b90c142f7ba1756 Time: 0.0310418 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x1f54ac6f2468a25d [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x1f54ac6f2468a25d Time: 0.0475074 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x5e921a04a7b0e583 Time: 0.0107964 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_linkable Tactic: 0x5e3d76022ffbdce2 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x5e3d76022ffbdce2 Time: 0.0189943 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_linkable Tactic: 0x58613478e5ec50a9 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x58613478e5ec50a9 Time: 0.0484541 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_linkable Tactic: 0x826da74f523d0cce [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x826da74f523d0cce Time: 0.0483048 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x10c7e671ac664e67 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x10c7e671ac664e67 Time: 0.028917 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0x54c7c858d168fe4a [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x54c7c858d168fe4a Time: 0.0169021 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xace5d20e37ef6496 Time: 0.0117795 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xcdd0ebe7641aaa23 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xcdd0ebe7641aaa23 Time: 0.0131354 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_linkable Tactic: 0x8ac200f673e0c67c [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x8ac200f673e0c67c Time: 0.0271337 [04/18/2023-18:36:00] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x1ba323eb9858b2a9 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x1ba323eb9858b2a9 Time: 0.026528 [04/18/2023-18:36:00] [V] [TRT] Fastest Tactic: 0xa085d13614221ec4 Time: 0.0105802 [04/18/2023-18:36:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa085d13614221ec4 [04/18/2023-18:36:00] [V] [TRT] =============== Computing costs for [04/18/2023-18:36:00] [V] [TRT] *************** Autotuning format combination: Int8(51200,400:4,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv (CudaDepthwiseConvolution) [04/18/2023-18:36:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv (CaskFlattenConvolution) [04/18/2023-18:36:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv (CaskConvolution) [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 0xc25454de2efcccdc [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xc25454de2efcccdc Time: 0.0165465 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: 0xff6944b17d5b2e32 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xff6944b17d5b2e32 Time: 0.0166029 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 0x14ef32afe5695907 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x14ef32afe5695907 Time: 0.0255756 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 0xb29abdd00304c881 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xb29abdd00304c881 Time: 0.0180629 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xfe80445f7bb61a99 Time: 0.0203703 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 0xec391424db39a74f [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xec391424db39a74f Time: 0.0181851 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 0x2cf4271504d30e29 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x2cf4271504d30e29 Time: 0.0254141 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 0x4d9d0d03129bceb1 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x4d9d0d03129bceb1 Time: 0.0166832 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 0x1db6e8cf1382fbe0 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x1db6e8cf1382fbe0 Time: 0.0251337 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: 0xa4ae2d82115c3e83 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xa4ae2d82115c3e83 Time: 0.0197446 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 0x69c4e2ca38eadce2 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x69c4e2ca38eadce2 Time: 0.017568 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 0xe01ccc14da28fa6f [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xe01ccc14da28fa6f Time: 0.0212467 [04/18/2023-18:36:00] [V] [TRT] Fastest Tactic: 0xc25454de2efcccdc Time: 0.0165465 [04/18/2023-18:36:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xc25454de2efcccdc [04/18/2023-18:36:00] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv (CaskFlattenConvolution) [04/18/2023-18:36:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv (CaskConvolution) [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x733ba2a91a48d431 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x733ba2a91a48d431 Time: 0.00641292 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0xf04572b287451f42 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xf04572b287451f42 Time: 0.00884249 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x5e4f6d7c83746fd6 Time: 0.00623523 [04/18/2023-18:36:00] [V] [TRT] Fastest Tactic: 0x5e4f6d7c83746fd6 Time: 0.00623523 [04/18/2023-18:36:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-18:36:00] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv (CaskFlattenConvolution) [04/18/2023-18:36:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv (CaskConvolution) [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xa71946688cad8664 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xa71946688cad8664 Time: 0.00558084 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x1e55f8b415964e81 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x1e55f8b415964e81 Time: 0.0113175 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0xa2f15b0a75b7dcec [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xa2f15b0a75b7dcec Time: 0.00913086 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9003f5f7ff9b1aec [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x9003f5f7ff9b1aec Time: 0.0186446 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x9ec201b34455146e [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x9ec201b34455146e Time: 0.0049879 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x91930a570b557437 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x91930a570b557437 Time: 0.0184114 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdf7e1bd6a496d667 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xdf7e1bd6a496d667 Time: 0.0112257 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6d377e4222886190 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x6d377e4222886190 Time: 0.00539615 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x271b998fe31732ef [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x271b998fe31732ef Time: 0.00753155 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xdc1f355deb032b87 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xdc1f355deb032b87 Time: 0.00595429 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x960e9baa2a6cad5b [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x960e9baa2a6cad5b Time: 0.00548114 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x2468d082d0ff7c9a [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x2468d082d0ff7c9a Time: 0.00530963 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x84942841d92b0552 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x84942841d92b0552 Time: 0.0117116 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xbeb5d91e1874a437 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xbeb5d91e1874a437 Time: 0.0110688 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcd229658c16b33cd [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xcd229658c16b33cd Time: 0.0189343 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xe742f4598442d2f1 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xe742f4598442d2f1 Time: 0.00751928 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x8141573686849b61 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x8141573686849b61 Time: 0.00746194 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x33a5c6dd086942c1 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x33a5c6dd086942c1 Time: 0.00509509 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7720f198395e7d3d [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x7720f198395e7d3d Time: 0.00735086 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x748f926574b7bdc4 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x748f926574b7bdc4 Time: 0.0189034 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb86b920539eb9c79 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xb86b920539eb9c79 Time: 0.0112612 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x60b880e28fee7a0c [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x60b880e28fee7a0c Time: 0.0186234 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcf64a2ae51bf6b36 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xcf64a2ae51bf6b36 Time: 0.00522775 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x844ea9c00f711f19 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x844ea9c00f711f19 Time: 0.00726057 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x65fbe45b4cb1d8a5 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x65fbe45b4cb1d8a5 Time: 0.00514645 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x3f2b14dec582741e [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x3f2b14dec582741e Time: 0.00536415 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0x445983715412fbda [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x445983715412fbda Time: 0.00566558 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x5bd8221bd57baf93 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x5bd8221bd57baf93 Time: 0.00553565 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0xb5f710b331ba8377 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xb5f710b331ba8377 Time: 0.0191817 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5f1a472d416ff35e [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x5f1a472d416ff35e Time: 0.00605333 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x991db9fd58152c33 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x991db9fd58152c33 Time: 0.0117025 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6e9c17a33c93d9b0 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x6e9c17a33c93d9b0 Time: 0.00716914 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x6986b0c6a136276e [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x6986b0c6a136276e Time: 0.012288 [04/18/2023-18:36:00] [V] [TRT] Fastest Tactic: 0x9ec201b34455146e Time: 0.0049879 [04/18/2023-18:36:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9ec201b34455146e [04/18/2023-18:36:00] [V] [TRT] *************** Autotuning format combination: Int8(6400,400:32,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv (CaskFlattenConvolution) [04/18/2023-18:36:00] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv (CaskConvolution) [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x5812ced7874b44d1 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x5812ced7874b44d1 Time: 0.00673226 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x43e3804f158e597d [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x43e3804f158e597d Time: 0.00933314 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7524377e24bc511f [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x7524377e24bc511f Time: 0.00513126 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 0x264d83735b1cba13 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x264d83735b1cba13 Time: 0.0096451 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0x3e116db8858d0d41 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x3e116db8858d0d41 Time: 0.00658909 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x758f8b2079a95b2e [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x758f8b2079a95b2e Time: 0.00655501 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x7de8ad674a85e82a [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x7de8ad674a85e82a Time: 0.00481783 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 0x8f07802f58d278c0 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x8f07802f58d278c0 Time: 0.0145705 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x1cfa820c55616892 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x1cfa820c55616892 Time: 0.00924486 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xccdb99df0646c7b3 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xccdb99df0646c7b3 Time: 0.00494597 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcf392eca056b8d88 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xcf392eca056b8d88 Time: 0.0145733 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x4f8662a723b489e1 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x4f8662a723b489e1 Time: 0.00483185 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x8e1dd2962c589dd4 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x8e1dd2962c589dd4 Time: 0.00503819 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xaba07efc49c11a6c [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xaba07efc49c11a6c Time: 0.0143355 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xd7985d83133bcf37 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xd7985d83133bcf37 Time: 0.00524604 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xb34706d47a62a016 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xb34706d47a62a016 Time: 0.00503661 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x8486adb55ae0ca6c [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x8486adb55ae0ca6c Time: 0.00898743 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x86d1488f426124e1 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x86d1488f426124e1 Time: 0.00493604 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xcba01f45d37a76a0 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xcba01f45d37a76a0 Time: 0.00674265 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x62a338704beec449 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x62a338704beec449 Time: 0.0149065 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x68f52f0a3f1c5b56 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x68f52f0a3f1c5b56 Time: 0.0064473 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0xdb3ae212a7704d44 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xdb3ae212a7704d44 Time: 0.00521535 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 0x4e7f02f91ddf4673 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x4e7f02f91ddf4673 Time: 0.0150816 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 0xaceaca2c82ab40f3 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xaceaca2c82ab40f3 Time: 0.00541884 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xaa30815cbd0f74b7 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xaa30815cbd0f74b7 Time: 0.0144206 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x6c336d1b7c64ffa3 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x6c336d1b7c64ffa3 Time: 0.00630479 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 0xb7a90e7097d64877 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0xb7a90e7097d64877 Time: 0.00542121 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x682fae8be946411d [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x682fae8be946411d Time: 0.00951629 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x70ffb5fe2e1321e3 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x70ffb5fe2e1321e3 Time: 0.00920686 [04/18/2023-18:36:00] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 0x27fb8661fea664b3 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x27fb8661fea664b3 Time: 0.00514547 [04/18/2023-18:36:00] [V] [TRT] Fastest Tactic: 0x7de8ad674a85e82a Time: 0.00481783 [04/18/2023-18:36:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x7de8ad674a85e82a [04/18/2023-18:36:00] [V] [TRT] =============== Computing costs for [04/18/2023-18:36:00] [V] [TRT] *************** Autotuning format combination: Float(102000,400,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270706 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00257429 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00243417 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00283778 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00257347 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00242534 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0034068 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0028885 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00274787 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0025582 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00268859 [04/18/2023-18:36:00] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.00242534 [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWise) [04/18/2023-18:36:00] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [04/18/2023-18:36:00] [V] [TRT] *************** Autotuning format combination: Float(102000,400,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00273311 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00256188 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00243983 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0027484 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00261502 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00242867 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00345676 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00285293 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00263447 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00255225 [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00270051 [04/18/2023-18:36:00] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.00242867 [04/18/2023-18:36:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [04/18/2023-18:36:00] [V] [TRT] *************** Autotuning format combination: Float(102000,1,5100,255) -> Float(102000,1,5100,255) *************** [04/18/2023-18:36:00] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-18:36:00] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00268445 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00257314 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00245958 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00279077 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00256514 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0024382 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0033936 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00287223 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00270258 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00255127 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00269766 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.0024382 [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWise) [04/18/2023-18:36:01] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Float(25600,1:4,1280,64) -> Float(25600,1:4,1280,64) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00254709 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00270749 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00282604 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00271733 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00302543 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00306976 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0029919 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00331065 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.003304 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00347625 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00257257 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00271034 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0026171 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00313302 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00287214 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00273001 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00342694 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00313491 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00286949 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00300105 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0028842 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00282631 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00299124 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0035952 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001c Time: 0.002528 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00254613 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00286409 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.002528 [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWise) [04/18/2023-18:36:01] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Float(3200,400:32,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00271931 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00310907 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00374834 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00514743 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0027169 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.0027169 [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWise) [04/18/2023-18:36:01] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Float(3200,400:32,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00300581 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0034977 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00477684 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00732183 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0026792 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00303048 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0035952 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00509746 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00303105 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00268622 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.0026792 [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Float(1:4,400,20,1) -> Float(1:4,400,20,1) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00342215 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00408419 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0054483 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00342215 [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(102000,400,20,1) -> Float(102000,400,20,1) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00267429 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00257927 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00243216 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00279648 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00256359 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00245501 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0034572 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0028558 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00261494 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00252295 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00274243 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x0000000000000002 Time: 0.00243216 [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000002 [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(102000,400,20,1) -> Half(102000,400,20,1) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0026924 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00257159 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00243014 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00272337 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00255022 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00238949 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00345818 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00284612 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00255682 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00245044 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00270508 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x0000000000000005 Time: 0.00238949 [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWise) [04/18/2023-18:36:01] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(51200,400:2,20,1) -> Half(51200,400:2,20,1) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00271181 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00271232 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00261993 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00311583 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00285696 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00270206 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00392191 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00330982 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00302752 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.003002 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00320173 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00307832 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00281331 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00308387 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00422266 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00266184 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00373873 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00302057 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.002715 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00271077 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00278453 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0031874 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x0000000000000002 Time: 0.00261993 [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWise) [04/18/2023-18:36:01] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000002 [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(12800,1:8,640,32) -> Half(12800,1:8,640,32) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00270258 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00268301 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00438968 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00272699 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00306636 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00291797 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00340648 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00345143 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00315886 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00299762 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00253875 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00270396 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00256278 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0028608 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00270387 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00274079 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00337946 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00301343 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00287012 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00286345 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0025707 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00282299 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00307112 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00342966 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00290404 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00284253 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00299848 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0038015 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00251308 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00254581 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00259518 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00294288 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00251308 [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWise) [04/18/2023-18:36:01] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(6400,1:16,320,16) -> Half(6400,1:16,320,16) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00248828 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00340778 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00286117 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00322448 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00316124 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00291806 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00392377 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00357646 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00325974 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00302457 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00257208 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00271345 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.002865 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00337563 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00254476 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00270353 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00302724 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00344838 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00251397 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00254155 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00259061 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x000000000000000a Time: 0.00248828 [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWise) [04/18/2023-18:36:01] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000000a [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(3200,400:32,20,1) -> Float(3200,400:32,20,1) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00255812 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00285806 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00324622 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00424887 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00256041 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.00255812 [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(3200,400:32,20,1) -> Half(3200,400:32,20,1) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00257731 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00298886 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00380752 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00553424 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00253522 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00274303 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00316353 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00421849 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00258882 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0025631 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.00253522 [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWise) [04/18/2023-18:36:01] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(1:8,400,20,1) -> Half(1:8,400,20,1) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00459614 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00456557 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00603219 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00861956 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.00456557 [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(102000:32,400,20,1) -> Half(102000:32,400,20,1) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Sigmoid_2) (PointWiseV2) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0256922 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.0264777 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0275261 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0237545 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0229407 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0233064 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0236611 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001b Time: 0.025187 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0258926 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0230296 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.0229407 [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-18:36:01] [V] [TRT] =============== Computing costs for [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Float(102000,400,20,1) -> Float(102000,34000,1700,85,1) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_4 + /model.77/Transpose_2 (Shuffle) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00446886 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.01288 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00446886 [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Float(102000,1,5100,255) -> Float(102000,34000,1,1700,20) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_4 + /model.77/Transpose_2 (Shuffle) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00589915 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0124552 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00589915 [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Float(25600,1:4,1280,64) -> Float(25500,8500,1:4,425,5) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_4 + /model.77/Transpose_2 (Shuffle) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00607657 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0158048 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00607657 [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Float(3200,400:32,20,1) -> Float(5100,1700,1700:32,85,1) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_4 + /model.77/Transpose_2 (Shuffle) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0170651 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0158085 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0158085 [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(102000,400,20,1) -> Half(102000,34000,1700,85,1) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_4 + /model.77/Transpose_2 (Shuffle) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00363474 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0133162 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00363474 [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(51200,400:2,20,1) -> Half(51000,17000,1700:2,85,1) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_4 + /model.77/Transpose_2 (Shuffle) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00373849 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0136977 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00373849 [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(25600,1:4,1280,64) -> Half(25500,8500,1:4,425,5) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_4 + /model.77/Transpose_2 (Shuffle) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00611276 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0125406 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00611276 [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(12800,1:8,640,32) -> Half(15300,5100,1:8,255,3) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_4 + /model.77/Transpose_2 (Shuffle) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00690264 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0124693 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00690264 [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(6400,1:16,320,16) -> Half(10200,3400,1:16,170,2) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_4 + /model.77/Transpose_2 (Shuffle) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00904371 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0126659 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00904371 [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(3200,400:32,20,1) -> Half(5100,1700,1700:32,85,1) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_4 + /model.77/Transpose_2 (Shuffle) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00916343 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0128057 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00916343 [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-18:36:01] [V] [TRT] =============== Computing costs for [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Float(102000,34000,1700,85,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Split_2 (Slice) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00224821 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00224821 [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Split_2 (Padding) [04/18/2023-18:36:01] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(102000,34000,1700,85,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Split_2 (Slice) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00225864 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00225864 [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Split_2 (Padding) [04/18/2023-18:36:01] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(51000,17000,1700:2,85,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Split_2 (Padding) [04/18/2023-18:36:01] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(15300,5100,1:8,255,3) -> Half(360,120,1:8,6,3) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Split_2 (Padding) [04/18/2023-18:36:01] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:36:01] [V] [TRT] =============== Computing costs for [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Float(102000,34000,1700,85,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_122 (Slice) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00225329 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00225329 [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_122 (Padding) [04/18/2023-18:36:01] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(102000,34000,1700,85,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_122 (Slice) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00224364 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00224364 [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_122 (Padding) [04/18/2023-18:36:01] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(51000,17000,1700:2,85,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_122 (Padding) [04/18/2023-18:36:01] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(15300,5100,1:8,255,3) -> Half(360,120,1:8,6,3) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_122 (Padding) [04/18/2023-18:36:01] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:36:01] [V] [TRT] =============== Computing costs for [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Float(102000,34000,1700,85,1) -> Float(102000,34000,1700,85,1) long-strided *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_123 (Slice) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00294363 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00294363 [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_123 (Padding) [04/18/2023-18:36:01] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Float(102000,34000,1700,85,1) -> Float(97200,32400,1620,81,1) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_123 (Slice) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00285517 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00285517 [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_123 (Padding) [04/18/2023-18:36:01] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(102000,34000,1700,85,1) -> Half(102000,34000,1700,85,1) long-strided *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_123 (Slice) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00285472 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00285472 [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_123 (Padding) [04/18/2023-18:36:01] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(102000,34000,1700,85,1) -> Half(97200,32400,1620,81,1) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_123 (Slice) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00283706 [04/18/2023-18:36:01] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00283706 [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_123 (Padding) [04/18/2023-18:36:01] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:36:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0x0000000000000000 [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(51000,17000,1700:2,85,1) -> Half(51000,17000,1700:2,85,1) long-strided *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_123 (Padding) [04/18/2023-18:36:01] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(51000,17000,1700:2,85,1) -> Half(48600,16200,1620:2,81,1) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_123 (Padding) [04/18/2023-18:36:01] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(15300,5100,1:8,255,3) -> Half(15300,5100,1:8,255,3) long-strided *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_123 (Padding) [04/18/2023-18:36:01] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Half(15300,5100,1:8,255,3) -> Half(14580,4860,1:8,243,3) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: /model.77/Split_2_123 (Padding) [04/18/2023-18:36:01] [V] [TRT] Padding has no valid tactics for this config, skipping [04/18/2023-18:36:01] [V] [TRT] =============== Computing costs for [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: -> Float(800,800,40,2,1) *************** [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: -> Half(800,800,40,2,1) *************** [04/18/2023-18:36:01] [V] [TRT] =============== Computing costs for [04/18/2023-18:36:01] [V] [TRT] *************** Autotuning format combination: Float(2400,800,40,2,1), Float(800,800,40,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:36:01] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00224514 [04/18/2023-18:36:01] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00246495 [04/18/2023-18:36:02] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00232627 [04/18/2023-18:36:02] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00274001 [04/18/2023-18:36:02] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00246944 [04/18/2023-18:36:02] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00254188 [04/18/2023-18:36:02] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00335033 [04/18/2023-18:36:03] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00293327 [04/18/2023-18:36:03] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0025938 [04/18/2023-18:36:03] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0029899 [04/18/2023-18:36:03] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00246975 [04/18/2023-18:36:03] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00224514 [04/18/2023-18:36:03] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWise) [04/18/2023-18:36:03] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 [04/18/2023-18:36:03] [V] [TRT] *************** Autotuning format combination: Float(2400,800,40,2,1), Float(800,800,40,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:36:03] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-18:36:03] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00259815 [04/18/2023-18:36:03] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00276598 [04/18/2023-18:36:04] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00273975 [04/18/2023-18:36:04] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00306714 [04/18/2023-18:36:04] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00291993 [04/18/2023-18:36:04] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00273967 [04/18/2023-18:36:04] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00390388 [04/18/2023-18:36:04] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00331221 [04/18/2023-18:36:05] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00295212 [04/18/2023-18:36:05] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00286226 [04/18/2023-18:36:05] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00248355 [04/18/2023-18:36:05] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00248355 [04/18/2023-18:36:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:36:05] [V] [TRT] *************** Autotuning format combination: Float(2400,800,1,40,20), Float(800,800,1,40,20) -> Float(2400,800,1,40,20) *************** [04/18/2023-18:36:05] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-18:36:05] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00239771 [04/18/2023-18:36:05] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00268572 [04/18/2023-18:36:05] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00248654 [04/18/2023-18:36:05] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00300581 [04/18/2023-18:36:05] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00271491 [04/18/2023-18:36:05] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00265287 [04/18/2023-18:36:05] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00372595 [04/18/2023-18:36:05] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00318242 [04/18/2023-18:36:05] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00288201 [04/18/2023-18:36:05] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00284585 [04/18/2023-18:36:05] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00241143 [04/18/2023-18:36:05] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00239771 [04/18/2023-18:36:05] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWise) [04/18/2023-18:36:05] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 [04/18/2023-18:36:05] [V] [TRT] *************** Autotuning format combination: Float(600,200,1:4,10,5), Float(200,200,1:4,10,5) -> Float(600,200,1:4,10,5) *************** [04/18/2023-18:36:05] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-18:36:05] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00284657 [04/18/2023-18:36:05] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00309038 [04/18/2023-18:36:06] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00367367 [04/18/2023-18:36:06] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00354587 [04/18/2023-18:36:06] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00355791 [04/18/2023-18:36:06] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00362149 [04/18/2023-18:36:06] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.004574 [04/18/2023-18:36:06] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00458471 [04/18/2023-18:36:07] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00455243 [04/18/2023-18:36:07] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00469161 [04/18/2023-18:36:07] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00275174 [04/18/2023-18:36:07] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00294372 [04/18/2023-18:36:07] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00298771 [04/18/2023-18:36:08] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00333661 [04/18/2023-18:36:08] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00352558 [04/18/2023-18:36:08] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00369418 [04/18/2023-18:36:08] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00407276 [04/18/2023-18:36:08] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00457157 [04/18/2023-18:36:09] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00492705 [04/18/2023-18:36:09] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00604933 [04/18/2023-18:36:09] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00261029 [04/18/2023-18:36:09] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00273579 [04/18/2023-18:36:09] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00319482 [04/18/2023-18:36:09] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00373544 [04/18/2023-18:36:10] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00287744 [04/18/2023-18:36:10] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00258898 [04/18/2023-18:36:10] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00250317 [04/18/2023-18:36:10] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.00250317 [04/18/2023-18:36:10] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWise) [04/18/2023-18:36:10] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [04/18/2023-18:36:10] [V] [TRT] *************** Autotuning format combination: Float(120,40,40:32,2,1), Float(40,40,40:32,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-18:36:10] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-18:36:10] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00294185 [04/18/2023-18:36:10] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00372782 [04/18/2023-18:36:11] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00488092 [04/18/2023-18:36:11] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00735086 [04/18/2023-18:36:11] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00288896 [04/18/2023-18:36:11] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00288896 [04/18/2023-18:36:11] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWise) [04/18/2023-18:36:11] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-18:36:11] [V] [TRT] *************** Autotuning format combination: Float(120,40,40:32,2,1), Float(40,40,40:32,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-18:36:11] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-18:36:11] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00349146 [04/18/2023-18:36:11] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00552281 [04/18/2023-18:36:11] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00814654 [04/18/2023-18:36:12] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0098947 [04/18/2023-18:36:12] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00293728 [04/18/2023-18:36:12] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00350562 [04/18/2023-18:36:12] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00457971 [04/18/2023-18:36:12] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00642981 [04/18/2023-18:36:13] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00337946 [04/18/2023-18:36:13] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00289646 [04/18/2023-18:36:13] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00289646 [04/18/2023-18:36:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-18:36:13] [V] [TRT] *************** Autotuning format combination: Float(800,1:4,40,2,1), Float(800,1:4,40,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:36:13] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-18:36:13] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00274096 [04/18/2023-18:36:13] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00257853 [04/18/2023-18:36:13] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00255314 [04/18/2023-18:36:13] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.00255314 [04/18/2023-18:36:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [04/18/2023-18:36:13] [V] [TRT] *************** Autotuning format combination: Half(2400,800,40,2,1), Half(800,800,40,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:36:13] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-18:36:13] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00243828 [04/18/2023-18:36:14] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00267954 [04/18/2023-18:36:14] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00257674 [04/18/2023-18:36:14] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00312069 [04/18/2023-18:36:14] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00291657 [04/18/2023-18:36:14] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00271871 [04/18/2023-18:36:14] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00388856 [04/18/2023-18:36:15] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00337106 [04/18/2023-18:36:15] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00296518 [04/18/2023-18:36:15] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00276791 [04/18/2023-18:36:15] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00245354 [04/18/2023-18:36:15] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00243828 [04/18/2023-18:36:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 [04/18/2023-18:36:15] [V] [TRT] *************** Autotuning format combination: Half(2400,800,40,2,1), Half(800,800,40,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:36:15] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-18:36:15] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252576 [04/18/2023-18:36:15] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00276114 [04/18/2023-18:36:16] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00259857 [04/18/2023-18:36:16] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00310264 [04/18/2023-18:36:16] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00286427 [04/18/2023-18:36:16] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00264957 [04/18/2023-18:36:16] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00381763 [04/18/2023-18:36:17] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0033347 [04/18/2023-18:36:17] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00298562 [04/18/2023-18:36:17] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00285769 [04/18/2023-18:36:17] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00249773 [04/18/2023-18:36:17] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00249773 [04/18/2023-18:36:17] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWise) [04/18/2023-18:36:17] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:36:17] [V] [TRT] *************** Autotuning format combination: Half(1200,400,40:2,2,1), Half(400,400,40:2,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-18:36:17] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-18:36:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00259502 [04/18/2023-18:36:17] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00298295 [04/18/2023-18:36:18] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00284872 [04/18/2023-18:36:18] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00342324 [04/18/2023-18:36:18] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00362731 [04/18/2023-18:36:18] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00332885 [04/18/2023-18:36:18] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00433011 [04/18/2023-18:36:18] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00419213 [04/18/2023-18:36:19] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00429082 [04/18/2023-18:36:19] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00447071 [04/18/2023-18:36:19] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00260214 [04/18/2023-18:36:19] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00277029 [04/18/2023-18:36:19] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00275165 [04/18/2023-18:36:20] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00319157 [04/18/2023-18:36:20] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00309846 [04/18/2023-18:36:20] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00268902 [04/18/2023-18:36:20] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00410188 [04/18/2023-18:36:20] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00354709 [04/18/2023-18:36:20] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00374025 [04/18/2023-18:36:21] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00306266 [04/18/2023-18:36:21] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00254364 [04/18/2023-18:36:21] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00266006 [04/18/2023-18:36:21] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00254364 [04/18/2023-18:36:21] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWise) [04/18/2023-18:36:21] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:36:21] [V] [TRT] *************** Autotuning format combination: Half(360,120,1:8,6,3), Half(120,120,1:8,6,3) -> Half(360,120,1:8,6,3) *************** [04/18/2023-18:36:21] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-18:36:21] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00282371 [04/18/2023-18:36:21] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0030862 [04/18/2023-18:36:22] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.003187 [04/18/2023-18:36:22] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00344892 [04/18/2023-18:36:22] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00362137 [04/18/2023-18:36:22] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00340604 [04/18/2023-18:36:22] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00422911 [04/18/2023-18:36:23] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00411611 [04/18/2023-18:36:23] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00368047 [04/18/2023-18:36:23] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00371727 [04/18/2023-18:36:23] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00282138 [04/18/2023-18:36:23] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00295995 [04/18/2023-18:36:24] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00335638 [04/18/2023-18:36:24] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00321321 [04/18/2023-18:36:24] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00320975 [04/18/2023-18:36:24] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00301095 [04/18/2023-18:36:24] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00356126 [04/18/2023-18:36:25] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00336967 [04/18/2023-18:36:25] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00334958 [04/18/2023-18:36:25] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00335203 [04/18/2023-18:36:25] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00302267 [04/18/2023-18:36:25] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00320477 [04/18/2023-18:36:26] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00301438 [04/18/2023-18:36:26] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00332534 [04/18/2023-18:36:26] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00628452 [04/18/2023-18:36:26] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00308406 [04/18/2023-18:36:26] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00321473 [04/18/2023-18:36:27] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00326244 [04/18/2023-18:36:27] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00306169 [04/18/2023-18:36:27] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00336255 [04/18/2023-18:36:27] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0039887 [04/18/2023-18:36:27] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00321463 [04/18/2023-18:36:27] [V] [TRT] Fastest Tactic: 0x000000000000000a Time: 0.00282138 [04/18/2023-18:36:27] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWise) [04/18/2023-18:36:27] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000000a [04/18/2023-18:36:27] [V] [TRT] *************** Autotuning format combination: Half(240,80,1:16,4,2), Half(80,80,1:16,4,2) -> Half(240,80,1:16,4,2) *************** [04/18/2023-18:36:27] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-18:36:27] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00296163 [04/18/2023-18:36:28] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0032613 [04/18/2023-18:36:28] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00340974 [04/18/2023-18:36:28] [V] [TRT] Tactic: 0x000000000000000d Time: 0.003695 [04/18/2023-18:36:28] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00381811 [04/18/2023-18:36:28] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00341029 [04/18/2023-18:36:29] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00435865 [04/18/2023-18:36:29] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00418155 [04/18/2023-18:36:29] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00384193 [04/18/2023-18:36:29] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00487375 [04/18/2023-18:36:30] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00297695 [04/18/2023-18:36:30] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00305683 [04/18/2023-18:36:30] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00334012 [04/18/2023-18:36:30] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00372665 [04/18/2023-18:36:30] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00301067 [04/18/2023-18:36:30] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00325049 [04/18/2023-18:36:31] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0030934 [04/18/2023-18:36:31] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0033819 [04/18/2023-18:36:31] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00527192 [04/18/2023-18:36:31] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00276484 [04/18/2023-18:36:31] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00275402 [04/18/2023-18:36:31] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00275402 [04/18/2023-18:36:31] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWise) [04/18/2023-18:36:31] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-18:36:31] [V] [TRT] *************** Autotuning format combination: Half(120,40,40:32,2,1), Half(40,40,40:32,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-18:36:31] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-18:36:32] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0027213 [04/18/2023-18:36:32] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00305323 [04/18/2023-18:36:32] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00362583 [04/18/2023-18:36:32] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00437306 [04/18/2023-18:36:32] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00276572 [04/18/2023-18:36:32] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.0027213 [04/18/2023-18:36:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-18:36:32] [V] [TRT] *************** Autotuning format combination: Half(120,40,40:32,2,1), Half(40,40,40:32,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-18:36:32] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-18:36:32] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00291909 [04/18/2023-18:36:33] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00357096 [04/18/2023-18:36:33] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00469368 [04/18/2023-18:36:33] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00612457 [04/18/2023-18:36:33] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00276774 [04/18/2023-18:36:33] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0030505 [04/18/2023-18:36:34] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0036464 [04/18/2023-18:36:34] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00474411 [04/18/2023-18:36:34] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00289938 [04/18/2023-18:36:34] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0027363 [04/18/2023-18:36:34] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.0027363 [04/18/2023-18:36:34] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWise) [04/18/2023-18:36:34] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-18:36:34] [V] [TRT] *************** Autotuning format combination: Half(800,1:8,40,2,1), Half(800,1:8,40,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:36:34] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-18:36:34] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00275895 [04/18/2023-18:36:34] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00290405 [04/18/2023-18:36:35] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00277556 [04/18/2023-18:36:35] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0025911 [04/18/2023-18:36:35] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.0025911 [04/18/2023-18:36:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-18:36:35] [V] [TRT] *************** Autotuning format combination: Half(800,800:32,40,2,1), Half(800,800:32,40,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:36:35] [V] [TRT] --------------- Timing Runner: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) (PointWiseV2) [04/18/2023-18:36:35] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00287735 [04/18/2023-18:36:35] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00370309 [04/18/2023-18:36:35] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00486507 [04/18/2023-18:36:36] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0072016 [04/18/2023-18:36:36] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00287543 [04/18/2023-18:36:36] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00336967 [04/18/2023-18:36:36] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00420733 [04/18/2023-18:36:36] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00585362 [04/18/2023-18:36:36] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00287991 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00285293 [04/18/2023-18:36:37] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00285293 [04/18/2023-18:36:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-18:36:37] [V] [TRT] =============== Computing costs for [04/18/2023-18:36:37] [V] [TRT] *************** Autotuning format combination: -> Float(6,2,2,2,1) *************** [04/18/2023-18:36:37] [V] [TRT] *************** Autotuning format combination: -> Half(6,2,2,2,1) *************** [04/18/2023-18:36:37] [V] [TRT] =============== Computing costs for [04/18/2023-18:36:37] [V] [TRT] *************** Autotuning format combination: Float(2400,800,40,2,1), Float(6,2,2,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:36:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00294139 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00311722 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0031366 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00317816 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00328717 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00300609 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00352178 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00351487 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00349748 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00335872 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00254605 [04/18/2023-18:36:37] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00254605 [04/18/2023-18:36:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWise) [04/18/2023-18:36:37] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:36:37] [V] [TRT] *************** Autotuning format combination: Float(2400,800,40,2,1), Float(6,2,2,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:36:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00289856 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00302743 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00299686 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00317775 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.003333 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00305974 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00348386 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00362937 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00359006 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00333927 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00274743 [04/18/2023-18:36:37] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00274743 [04/18/2023-18:36:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:36:37] [V] [TRT] *************** Autotuning format combination: Float(2400,800,1,40,20), Float(6,2,1,2,1) -> Float(2400,800,1,40,20) *************** [04/18/2023-18:36:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00277987 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00281627 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00337531 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00281797 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00281089 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00279182 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00288933 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00357417 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00289234 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00282093 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00277723 [04/18/2023-18:36:37] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00277723 [04/18/2023-18:36:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWise) [04/18/2023-18:36:37] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:36:37] [V] [TRT] *************** Autotuning format combination: Float(600,200,1:4,10,5), Float(6,2,1:4,2,1) -> Float(600,200,1:4,10,5) *************** [04/18/2023-18:36:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00285096 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0029232 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00326535 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00296135 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00301314 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00294297 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00324084 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00325517 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00304068 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00311831 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0037841 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00281994 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00287168 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00290953 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00369184 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00298333 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00319959 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00315001 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0031672 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00302886 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0027775 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00345263 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00275965 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0028532 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00346797 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00277679 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00360309 [04/18/2023-18:36:37] [V] [TRT] Fastest Tactic: 0x0000000000000016 Time: 0.00275965 [04/18/2023-18:36:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWise) [04/18/2023-18:36:37] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000016 [04/18/2023-18:36:37] [V] [TRT] *************** Autotuning format combination: Float(120,40,40:32,2,1), Float(6,2,2:32,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-18:36:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0027855 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00286811 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00300267 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00332396 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00372126 [04/18/2023-18:36:37] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.0027855 [04/18/2023-18:36:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWise) [04/18/2023-18:36:37] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-18:36:37] [V] [TRT] *************** Autotuning format combination: Float(120,40,40:32,2,1), Float(6,2,2:32,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-18:36:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00296714 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00405651 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00437527 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00492926 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00578939 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00284764 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00288091 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00319218 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00305021 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00252527 [04/18/2023-18:36:37] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00252527 [04/18/2023-18:36:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-18:36:37] [V] [TRT] *************** Autotuning format combination: Float(800,1:4,40,2,1), Float(2,1:4,2,2,1) -> Float(800,1:4,40,2,1) *************** [04/18/2023-18:36:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00253851 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00238682 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00238735 [04/18/2023-18:36:37] [V] [TRT] Fastest Tactic: 0x000000000000001d Time: 0.00238682 [04/18/2023-18:36:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [04/18/2023-18:36:37] [V] [TRT] *************** Autotuning format combination: Half(2400,800,40,2,1), Half(6,2,2,2,1) -> Float(2400,800,40,2,1) *************** [04/18/2023-18:36:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0025938 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00276677 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00268851 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00290139 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00304652 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00281134 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00315727 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00338052 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00314763 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00311324 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00269003 [04/18/2023-18:36:37] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0025938 [04/18/2023-18:36:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 [04/18/2023-18:36:37] [V] [TRT] *************** Autotuning format combination: Half(2400,800,40,2,1), Half(6,2,2,2,1) -> Half(2400,800,40,2,1) *************** [04/18/2023-18:36:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00332981 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00283984 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00280856 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00291456 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00368539 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00333108 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00316869 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00326036 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00322367 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00298933 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00455073 [04/18/2023-18:36:37] [V] [TRT] Fastest Tactic: 0x0000000000000002 Time: 0.00280856 [04/18/2023-18:36:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWise) [04/18/2023-18:36:37] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000002 [04/18/2023-18:36:37] [V] [TRT] *************** Autotuning format combination: Half(1200,400,40:2,2,1), Half(6,2,2:2,2,1) -> Half(1200,400,40:2,2,1) *************** [04/18/2023-18:36:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00279842 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00281788 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00281968 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00295575 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00288283 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00343597 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00327865 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00309807 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00362937 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00289317 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00322052 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00279517 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00278488 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00283115 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00281403 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0040066 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00307813 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00289865 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0028143 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00278172 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00278022 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00400584 [04/18/2023-18:36:37] [V] [TRT] Fastest Tactic: 0x000000000000001c Time: 0.00278022 [04/18/2023-18:36:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWise) [04/18/2023-18:36:37] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [04/18/2023-18:36:37] [V] [TRT] *************** Autotuning format combination: Half(360,120,1:8,6,3), Half(6,2,1:8,2,1) -> Half(360,120,1:8,6,3) *************** [04/18/2023-18:36:37] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00296079 [04/18/2023-18:36:37] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00308241 [04/18/2023-18:36:38] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00328457 [04/18/2023-18:36:38] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00346329 [04/18/2023-18:36:38] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00343619 [04/18/2023-18:36:38] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00337191 [04/18/2023-18:36:39] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00389399 [04/18/2023-18:36:39] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00382641 [04/18/2023-18:36:39] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00407086 [04/18/2023-18:36:39] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00378971 [04/18/2023-18:36:40] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0027833 [04/18/2023-18:36:40] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00304496 [04/18/2023-18:36:40] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0030648 [04/18/2023-18:36:40] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00328166 [04/18/2023-18:36:40] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00325631 [04/18/2023-18:36:41] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00323931 [04/18/2023-18:36:41] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00376144 [04/18/2023-18:36:41] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0035103 [04/18/2023-18:36:41] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00345546 [04/18/2023-18:36:41] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00331387 [04/18/2023-18:36:42] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00274234 [04/18/2023-18:36:42] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00303076 [04/18/2023-18:36:42] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00302295 [04/18/2023-18:36:42] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00342171 [04/18/2023-18:36:42] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00274562 [04/18/2023-18:36:43] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00271629 [04/18/2023-18:36:43] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00291017 [04/18/2023-18:36:43] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00317257 [04/18/2023-18:36:43] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00299895 [04/18/2023-18:36:43] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00281277 [04/18/2023-18:36:43] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00285392 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0026847 [04/18/2023-18:36:44] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.0026847 [04/18/2023-18:36:44] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWise) [04/18/2023-18:36:44] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-18:36:44] [V] [TRT] *************** Autotuning format combination: Half(240,80,1:16,4,2), Half(6,2,1:16,2,1) -> Half(240,80,1:16,4,2) *************** [04/18/2023-18:36:44] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00282407 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000000b Time: 0.003328 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00334926 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00396578 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0038246 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00350116 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00501927 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00433718 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00382256 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.0036725 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00268936 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00299714 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00317327 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00366 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00270508 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00286784 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00302752 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00339774 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00283357 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00273234 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00269156 [04/18/2023-18:36:44] [V] [TRT] Fastest Tactic: 0x0000000000000014 Time: 0.00268936 [04/18/2023-18:36:44] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWise) [04/18/2023-18:36:44] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000014 [04/18/2023-18:36:44] [V] [TRT] *************** Autotuning format combination: Half(120,40,40:32,2,1), Half(6,2,2:32,2,1) -> Float(120,40,40:32,2,1) *************** [04/18/2023-18:36:44] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00274458 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00295249 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00300571 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00332747 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00277714 [04/18/2023-18:36:44] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.00274458 [04/18/2023-18:36:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-18:36:44] [V] [TRT] *************** Autotuning format combination: Half(120,40,40:32,2,1), Half(6,2,2:32,2,1) -> Half(120,40,40:32,2,1) *************** [04/18/2023-18:36:44] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00282622 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00331782 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00383567 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00501439 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00268927 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00297301 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00321524 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0036376 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00285338 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00277495 [04/18/2023-18:36:44] [V] [TRT] Fastest Tactic: 0x0000000000000018 Time: 0.00268927 [04/18/2023-18:36:44] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWise) [04/18/2023-18:36:44] [V] [TRT] PointWise has no valid tactics for this config, skipping [04/18/2023-18:36:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000018 [04/18/2023-18:36:44] [V] [TRT] *************** Autotuning format combination: Half(800,1:8,40,2,1), Half(2,1:8,2,2,1) -> Half(800,1:8,40,2,1) *************** [04/18/2023-18:36:44] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00282604 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000001d Time: 0.00270655 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00265414 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00268241 [04/18/2023-18:36:44] [V] [TRT] Fastest Tactic: 0x000000000000001e Time: 0.00265414 [04/18/2023-18:36:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001e [04/18/2023-18:36:44] [V] [TRT] *************** Autotuning format combination: Half(800,800:32,40,2,1), Half(2,2:32,2,2,1) -> Half(800,800:32,40,2,1) *************** [04/18/2023-18:36:44] [V] [TRT] --------------- Timing Runner: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) (PointWiseV2) [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00316581 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00366312 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00434507 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00557802 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.00298733 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00314643 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00336011 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00400749 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00291648 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x000000000000001f Time: 0.00283644 [04/18/2023-18:36:44] [V] [TRT] Fastest Tactic: 0x000000000000001f Time: 0.00283644 [04/18/2023-18:36:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [04/18/2023-18:36:44] [V] [TRT] =============== Computing costs for [04/18/2023-18:36:44] [V] [TRT] *************** Autotuning format combination: Float(102000,34000,1700,85,1) -> Float(102000,85,1) *************** [04/18/2023-18:36:44] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5 (Shuffle) [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00252832 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0121825 [04/18/2023-18:36:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00252832 [04/18/2023-18:36:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-18:36:44] [V] [TRT] *************** Autotuning format combination: Float(102000,34000,1,1700,20) -> Float(1,85,1) *************** [04/18/2023-18:36:44] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5 (Shuffle) [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00455043 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0784823 [04/18/2023-18:36:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00455043 [04/18/2023-18:36:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-18:36:44] [V] [TRT] *************** Autotuning format combination: Float(25500,8500,1:4,425,5) -> Float(1:4,85,1) *************** [04/18/2023-18:36:44] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5 (Shuffle) [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.057248 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0181011 [04/18/2023-18:36:44] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0181011 [04/18/2023-18:36:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:36:44] [V] [TRT] *************** Autotuning format combination: Float(5100,1700,1700:32,85,1) -> Float(102000:32,85,1) *************** [04/18/2023-18:36:44] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5 (Shuffle) [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.514048 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0531992 [04/18/2023-18:36:44] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0531992 [04/18/2023-18:36:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:36:44] [V] [TRT] *************** Autotuning format combination: Half(102000,34000,1700,85,1) -> Half(102000,85,1) *************** [04/18/2023-18:36:44] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5 (Shuffle) [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00233991 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0120526 [04/18/2023-18:36:44] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.00233991 [04/18/2023-18:36:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [04/18/2023-18:36:44] [V] [TRT] *************** Autotuning format combination: Half(51000,17000,1700:2,85,1) -> Half(102000:2,85,1) *************** [04/18/2023-18:36:44] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5 (Shuffle) [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0163337 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0133885 [04/18/2023-18:36:44] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0133885 [04/18/2023-18:36:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:36:44] [V] [TRT] *************** Autotuning format combination: Half(25500,8500,1:4,425,5) -> Half(1:4,85,1) *************** [04/18/2023-18:36:44] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5 (Shuffle) [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0315191 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0230661 [04/18/2023-18:36:44] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0230661 [04/18/2023-18:36:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:36:44] [V] [TRT] *************** Autotuning format combination: Half(15300,5100,1:8,255,3) -> Half(1:8,85,1) *************** [04/18/2023-18:36:44] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5 (Shuffle) [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0636373 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0183383 [04/18/2023-18:36:44] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0183383 [04/18/2023-18:36:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:36:44] [V] [TRT] *************** Autotuning format combination: Half(10200,3400,1:16,170,2) -> Half(1:16,85,1) *************** [04/18/2023-18:36:44] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5 (Shuffle) [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.126245 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0235069 [04/18/2023-18:36:44] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.0235069 [04/18/2023-18:36:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:36:44] [V] [TRT] *************** Autotuning format combination: Half(5100,1700,1700:32,85,1) -> Half(102000:32,85,1) *************** [04/18/2023-18:36:44] [V] [TRT] --------------- Timing Runner: /model.77/Reshape_5 (Shuffle) [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.256393 [04/18/2023-18:36:44] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.023008 [04/18/2023-18:36:44] [V] [TRT] Fastest Tactic: 0x0000000000000001 Time: 0.023008 [04/18/2023-18:36:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [04/18/2023-18:36:44] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to PWN(/model.0/act/LeakyRelu) (/model.0/conv/Conv_output_0) from Float(3276800,102400,320,1) to Half(102400,102400:32,320,1) [04/18/2023-18:36:44] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to /model.15/m/MaxPool (/model.14/act/LeakyRelu_output_0) from Half(25600,6400:32,80,1) to Half(409600,6400:2,80,1) [04/18/2023-18:36:44] [V] [TRT] Adding reformat layer: Reformatted Output Tensor 0 to model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (/model.21/act/LeakyRelu_output_0) from Half(12800,1600:32,40,1) to Half(204800,1600:2,40,1) [04/18/2023-18:36:44] [V] [TRT] Formats and tactics selection completed in 321.465 seconds. [04/18/2023-18:36:44] [V] [TRT] After reformat layers: 141 layers [04/18/2023-18:36:44] [V] [TRT] Total number of blocks in pre-optimized block assignment: 95 [04/18/2023-18:36:44] [I] [TRT] Total Activation Memory: 25508693504 [04/18/2023-18:36:44] [I] [TRT] Detected 1 inputs and 4 output network tensors. [04/18/2023-18:36:44] [V] [TRT] model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 0xfe80445f7bb61a99 [04/18/2023-18:36:44] [V] [TRT] model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-18:36:44] [V] [TRT] model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:36:44] [V] [TRT] model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear + /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x3321b9c38b0ba08d [04/18/2023-18:36:44] [V] [TRT] model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-18:36:44] [V] [TRT] model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xb35096a016bb733a [04/18/2023-18:36:44] [V] [TRT] model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:36:44] [V] [TRT] /model.8/m/MaxPool Set Tactic Name: sm72_xmma_pooling_IMMA_NCxHW32_generic_kMAX Tactic: 0x94215b398b8eb3ba [04/18/2023-18:36:44] [V] [TRT] model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:36:44] [V] [TRT] model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear + /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:36:44] [V] [TRT] model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-18:36:44] [V] [TRT] model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-18:36:44] [V] [TRT] model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x4f35593c356e2e7e [04/18/2023-18:36:44] [V] [TRT] /model.15/m/MaxPool Set Tactic Name: sm50_xmma_pooling_CHWPacked_NCxHW2_kMAX Tactic: 0xc8ae100b63fd8921 [04/18/2023-18:36:44] [V] [TRT] model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:36:44] [V] [TRT] model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:36:44] [V] [TRT] model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear + /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:36:44] [V] [TRT] model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:36:44] [V] [TRT] model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:36:44] [V] [TRT] model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x3ffcb62b1c6bb94f [04/18/2023-18:36:44] [V] [TRT] /model.22/m/MaxPool Set Tactic Name: sm50_xmma_pooling_CHWPacked_NCxHW2_kMAX Tactic: 0xc8ae100b63fd8921 [04/18/2023-18:36:44] [V] [TRT] model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:36:44] [V] [TRT] model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:36:44] [V] [TRT] model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear + /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:36:44] [V] [TRT] model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-18:36:44] [V] [TRT] model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x83caf00de690c0ec [04/18/2023-18:36:44] [V] [TRT] model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x4df7e35b8de312d7 [04/18/2023-18:36:44] [V] [TRT] model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:36:44] [V] [TRT] model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear + /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:36:44] [V] [TRT] /model.31/m/MaxPool Set Tactic Name: sm72_xmma_pooling_IMMA_NCxHW32_generic_kMAX Tactic: 0x94215b398b8eb3ba [04/18/2023-18:36:44] [V] [TRT] /model.32/m/MaxPool Set Tactic Name: sm72_xmma_pooling_IMMA_NCxHW32_generic_kMAX Tactic: 0x94215b398b8eb3ba [04/18/2023-18:36:44] [V] [TRT] /model.33/m/MaxPool Set Tactic Name: sm72_xmma_pooling_IMMA_NCxHW32_generic_kMAX Tactic: 0x94215b398b8eb3ba [04/18/2023-18:36:44] [V] [TRT] model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x6eb8c2607f51ccff [04/18/2023-18:36:44] [V] [TRT] model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0x31de506085a332d4 [04/18/2023-18:36:44] [V] [TRT] model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:36:44] [V] [TRT] model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:36:44] [V] [TRT] model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear + /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:36:44] [V] [TRT] model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-18:36:44] [V] [TRT] model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:36:44] [V] [TRT] model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 0xc22b2f91e37e472a [04/18/2023-18:36:44] [V] [TRT] model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:36:44] [V] [TRT] model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:36:44] [V] [TRT] model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear + /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xa40d21cb7ebb07bf [04/18/2023-18:36:44] [V] [TRT] model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:36:44] [V] [TRT] model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:36:44] [V] [TRT] model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear + /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x25bf7139bbd93bc8 [04/18/2023-18:36:44] [V] [TRT] model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xbb88763c3b0e94d4 [04/18/2023-18:36:44] [V] [TRT] model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-18:36:44] [V] [TRT] model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x733ba2a91a48d431 [04/18/2023-18:36:44] [V] [TRT] model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:36:44] [V] [TRT] model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear + /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x0779fa4ac8f9f2ee [04/18/2023-18:36:44] [V] [TRT] model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear + /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-18:36:44] [V] [TRT] model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x5e921a04a7b0e583 [04/18/2023-18:36:44] [V] [TRT] model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear + /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_linkable Tactic: 0xace5d20e37ef6496 [04/18/2023-18:36:44] [V] [TRT] model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 0xd3f592fae61c7986 [04/18/2023-18:36:44] [V] [TRT] model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xfbcd5a1da537e27f [04/18/2023-18:36:44] [V] [TRT] model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x733ba2a91a48d431 [04/18/2023-18:36:44] [V] [TRT] model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_linkable Tactic: 0x90af0952ccc337b8 [04/18/2023-18:36:44] [V] [TRT] model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear + /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0xeb1602207b0c3d49 [04/18/2023-18:36:44] [V] [TRT] model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-18:36:44] [V] [TRT] model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0x7ddd3b3f55023bab [04/18/2023-18:36:45] [V] [TRT] model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear + /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1_linkable Tactic: 0x4862d9a1cd4ec818 [04/18/2023-18:36:45] [V] [TRT] model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3_linkable Tactic: 0xa085d13614221ec4 [04/18/2023-18:36:45] [V] [TRT] model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4 Tactic: 0x5e4f6d7c83746fd6 [04/18/2023-18:36:45] [V] [TRT] Layer: model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Host Persistent: 1664 Device Persistent: 614912 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: PWN(/model.0/act/LeakyRelu) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear + /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: /model.8/m/MaxPool Host Persistent: 1344 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear + /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Host Persistent: 5792 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: /model.15/m/MaxPool Host Persistent: 1280 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Host Persistent: 2560 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear + /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) Host Persistent: 2560 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Host Persistent: 5792 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: /model.22/m/MaxPool Host Persistent: 1280 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Host Persistent: 2560 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear + /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear + /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: /model.31/m/MaxPool Host Persistent: 1344 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: /model.32/m/MaxPool Host Persistent: 1344 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: /model.33/m/MaxPool Host Persistent: 1344 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Host Persistent: 5792 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear + /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Host Persistent: 5792 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear + /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear + /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Host Persistent: 5792 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear + /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: PWN(/model.77/Sigmoid) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear + /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) Host Persistent: 372 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) Host Persistent: 372 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear + /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) Host Persistent: 2560 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Host Persistent: 5792 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear + /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: PWN(/model.77/Sigmoid_1) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) Host Persistent: 372 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) Host Persistent: 372 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear + /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Host Persistent: 2816 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: PWN(/model.77/Sigmoid_2) Host Persistent: 244 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) Host Persistent: 372 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Layer: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) Host Persistent: 372 Device Persistent: 0 Scratch Memory: 0 [04/18/2023-18:36:45] [V] [TRT] Skipped printing memory information for 67 layers with 0 memory size i.e. Host Persistent + Device Persistent + Scratch Memory == 0. [04/18/2023-18:36:45] [I] [TRT] Total Host Persistent Memory: 190272 [04/18/2023-18:36:45] [I] [TRT] Total Device Persistent Memory: 614912 [04/18/2023-18:36:45] [I] [TRT] Total Scratch Memory: 0 [04/18/2023-18:36:45] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 31 MiB, GPU 214 MiB [04/18/2023-18:36:45] [I] [TRT] [BlockAssignment] Started assigning block shifts. This will take 94 steps to complete. [04/18/2023-18:36:45] [I] [TRT] [BlockAssignment] Algorithm ShiftNTopDown took 5.05061ms to assign 9 blocks to 94 nodes requiring 21939200 bytes. [04/18/2023-18:36:45] [V] [TRT] Total number of blocks in optimized block assignment: 9 [04/18/2023-18:36:45] [I] [TRT] Total Activation Memory: 21939200 [04/18/2023-18:36:45] [I] [TRT] (Sparsity) Layers eligible for sparse math: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu), model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu), model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear + /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu), model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu), model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu), model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu), model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu), model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear + /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu), model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu), model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu), model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu), model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu), model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear + /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu), model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu), model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu), model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu), model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu), model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear + /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu), model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu), model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu), model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu), model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu), model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear + /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu), model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu), model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu), model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu), model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear + /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu), model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu), model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu), model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu), model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu), model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear + /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu), model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu), model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu), model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear + /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu), model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu), model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu), model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear + /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu), model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear + /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu), model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu), model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear + /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu), model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu), model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu), model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear + /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu), model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu), model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu), model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear + /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu), model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) [04/18/2023-18:36:45] [I] [TRT] (Sparsity) TRT inference plan picked sparse implementation for layers: [04/18/2023-18:36:45] [V] [TRT] Finalize: model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv Set kernel index: 0 [04/18/2023-18:36:45] [V] [TRT] Finalize: PWN(/model.0/act/LeakyRelu) Set kernel index: 1 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu) Set kernel index: 2 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu) Set kernel index: 3 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear + /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu) Set kernel index: 3 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu) Set kernel index: 4 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu) Set kernel index: 4 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu) Set kernel index: 5 [04/18/2023-18:36:45] [V] [TRT] Finalize: /model.8/m/MaxPool Set kernel index: 6 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu) Set kernel index: 7 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear + /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu) Set kernel index: 7 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu) Set kernel index: 8 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu) Set kernel index: 8 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu) Set kernel index: 9 [04/18/2023-18:36:45] [V] [TRT] Finalize: /model.15/m/MaxPool Set kernel index: 10 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu) Set kernel index: 11 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu) Set kernel index: 12 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear + /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu) Set kernel index: 12 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu) Set kernel index: 13 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu) Set kernel index: 13 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) Set kernel index: 14 [04/18/2023-18:36:45] [V] [TRT] Finalize: /model.22/m/MaxPool Set kernel index: 10 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu) Set kernel index: 15 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu) Set kernel index: 16 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear + /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu) Set kernel index: 17 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu) Set kernel index: 18 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu) Set kernel index: 18 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu) Set kernel index: 19 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu) Set kernel index: 20 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear + /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu) Set kernel index: 21 [04/18/2023-18:36:45] [V] [TRT] Finalize: /model.31/m/MaxPool Set kernel index: 6 [04/18/2023-18:36:45] [V] [TRT] Finalize: /model.32/m/MaxPool Set kernel index: 6 [04/18/2023-18:36:45] [V] [TRT] Finalize: /model.33/m/MaxPool Set kernel index: 6 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu) Set kernel index: 22 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu) Set kernel index: 23 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu) Set kernel index: 24 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu) Set kernel index: 25 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear + /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu) Set kernel index: 25 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu) Set kernel index: 26 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu) Set kernel index: 27 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu) Set kernel index: 28 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu) Set kernel index: 29 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu) Set kernel index: 30 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear + /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu) Set kernel index: 30 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu) Set kernel index: 31 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu) Set kernel index: 31 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear + /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu) Set kernel index: 32 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu) Set kernel index: 33 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu) Set kernel index: 34 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv Set kernel index: 35 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu) Set kernel index: 36 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear + /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu) Set kernel index: 36 [04/18/2023-18:36:45] [V] [TRT] Finalize: PWN(/model.77/Sigmoid) Set kernel index: 37 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear + /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu) Set kernel index: 38 [04/18/2023-18:36:45] [V] [TRT] Finalize: PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add) Set kernel index: 39 [04/18/2023-18:36:45] [V] [TRT] Finalize: PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1) Set kernel index: 40 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu) Set kernel index: 41 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear + /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu) Set kernel index: 42 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu) Set kernel index: 43 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu) Set kernel index: 44 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv Set kernel index: 35 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu) Set kernel index: 45 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear + /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu) Set kernel index: 46 [04/18/2023-18:36:45] [V] [TRT] Finalize: PWN(/model.77/Sigmoid_1) Set kernel index: 47 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu) Set kernel index: 48 [04/18/2023-18:36:45] [V] [TRT] Finalize: PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1) Set kernel index: 49 [04/18/2023-18:36:45] [V] [TRT] Finalize: PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3) Set kernel index: 50 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu) Set kernel index: 48 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear + /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu) Set kernel index: 51 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu) Set kernel index: 52 [04/18/2023-18:36:45] [V] [TRT] Finalize: model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv Set kernel index: 53 [04/18/2023-18:36:45] [V] [TRT] Finalize: PWN(/model.77/Sigmoid_2) Set kernel index: 47 [04/18/2023-18:36:45] [V] [TRT] Finalize: PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2) Set kernel index: 54 [04/18/2023-18:36:45] [V] [TRT] Finalize: PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5) Set kernel index: 55 [04/18/2023-18:36:45] [V] [TRT] Total number of generated kernels selected for the engine: 56 [04/18/2023-18:36:45] [V] [TRT] Kernel: 0 CASK_STATIC [04/18/2023-18:36:45] [V] [TRT] Kernel: 1 TRT_SERIALIZABLE:generatedNativePointwise [04/18/2023-18:36:45] [V] [TRT] Kernel: 2 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 3 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 4 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 5 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 6 CASK_STATIC [04/18/2023-18:36:45] [V] [TRT] Kernel: 7 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 8 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 9 CASK_JIT [04/18/2023-18:36:45] [V] [TRT] Kernel: 10 CASK_STATIC [04/18/2023-18:36:45] [V] [TRT] Kernel: 11 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 12 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 13 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 14 CASK_JIT [04/18/2023-18:36:45] [V] [TRT] Kernel: 15 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 16 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 17 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 18 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 19 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 20 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 21 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 22 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 23 CASK_JIT [04/18/2023-18:36:45] [V] [TRT] Kernel: 24 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 25 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 26 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 27 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 28 CASK_JIT [04/18/2023-18:36:45] [V] [TRT] Kernel: 29 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 30 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 31 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 32 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 33 CASK_JIT [04/18/2023-18:36:45] [V] [TRT] Kernel: 34 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 35 CASK_STATIC [04/18/2023-18:36:45] [V] [TRT] Kernel: 36 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 37 TRT_SERIALIZABLE:generatedNativePointwise [04/18/2023-18:36:45] [V] [TRT] Kernel: 38 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 39 TRT_SERIALIZABLE:generatedNativePointwise [04/18/2023-18:36:45] [V] [TRT] Kernel: 40 TRT_SERIALIZABLE:generatedNativePointwise [04/18/2023-18:36:45] [V] [TRT] Kernel: 41 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 42 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 43 CASK_JIT [04/18/2023-18:36:45] [V] [TRT] Kernel: 44 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 45 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 46 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 47 TRT_SERIALIZABLE:generatedNativePointwise [04/18/2023-18:36:45] [V] [TRT] Kernel: 48 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 49 TRT_SERIALIZABLE:generatedNativePointwise [04/18/2023-18:36:45] [V] [TRT] Kernel: 50 TRT_SERIALIZABLE:generatedNativePointwise [04/18/2023-18:36:45] [V] [TRT] Kernel: 51 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 52 CASK_LINKABLE [04/18/2023-18:36:45] [V] [TRT] Kernel: 53 CASK_STATIC [04/18/2023-18:36:45] [V] [TRT] Kernel: 54 TRT_SERIALIZABLE:generatedNativePointwise [04/18/2023-18:36:45] [V] [TRT] Kernel: 55 TRT_SERIALIZABLE:generatedNativePointwise [04/18/2023-18:36:45] [V] [TRT] Disabling unused tactic source: CUDNN [04/18/2023-18:36:45] [V] [TRT] Disabling unused tactic source: CUBLAS, CUBLAS_LT [04/18/2023-18:36:45] [V] [TRT] Engine generation completed in 322.651 seconds. [04/18/2023-18:36:45] [V] [TRT] Deleting timing cache: 2987 entries, served 1847 hits since creation. [04/18/2023-18:36:45] [V] [TRT] Engine Layer Information: Layer(Constant): /model.77/Constant_2_output_0, Tactic: 0x0000000000000000, -> (Unnamed Layer* 634) [Constant]_output (Half[1,1,80,80,2]) Layer(Constant): /model.77/Constant_4_output_0, Tactic: 0x0000000000000000, -> (Unnamed Layer* 639) [Constant]_output (Half[1,3,1,1,2]) Layer(Constant): /model.77/Constant_8_output_0, Tactic: 0x0000000000000000, -> (Unnamed Layer* 662) [Constant]_output (Half[1,1,40,40,2]) Layer(Constant): /model.77/Constant_10_output_0, Tactic: 0x0000000000000000, -> (Unnamed Layer* 667) [Constant]_output (Half[1,3,1,1,2]) Layer(Reformat): /model.0/conv/_input_quantizer/QuantizeLinear, Tactic: 0x0000000000000000, images (Float[1,3,640,640]) -> /model.0/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,3:4,640,640]) Layer(CaskConvolution): model.0.conv.weight + /model.0/conv/_weight_quantizer/QuantizeLinear + /model.0/conv/Conv, Tactic: 0xfe80445f7bb61a99, /model.0/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,3:4,640,640]) -> /model.0/conv/Conv_output_0 (Float[1,32,320,320]) Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to PWN(/model.0/act/LeakyRelu), Tactic: 0x00000000000003ea, /model.0/conv/Conv_output_0 (Float[1,32,320,320]) -> Reformatted Input Tensor 0 to PWN(/model.0/act/LeakyRelu) (Half[1,32:32,320,320]) Layer(PointWiseV2): PWN(/model.0/act/LeakyRelu), Tactic: 0x000000000000000a, Reformatted Input Tensor 0 to PWN(/model.0/act/LeakyRelu) (Half[1,32:32,320,320]) -> /model.1/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,320,320]) Layer(CaskConvolution): model.1.conv.weight + /model.1/conv/_weight_quantizer/QuantizeLinear + /model.1/conv/Conv + PWN(/model.1/act/LeakyRelu), Tactic: 0xa085d13614221ec4, /model.1/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,320,320]) -> /model.2/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,160,160]) Layer(CaskConvolution): model.2.conv.weight + /model.2/conv/_weight_quantizer/QuantizeLinear + /model.2/conv/Conv + PWN(/model.2/act/LeakyRelu), Tactic: 0x3321b9c38b0ba08d, /model.2/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,160,160]) -> /model.7/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,160,160]) Layer(CaskConvolution): model.3.conv.weight + /model.3/conv/_weight_quantizer/QuantizeLinear + /model.3/conv/Conv + PWN(/model.3/act/LeakyRelu), Tactic: 0x3321b9c38b0ba08d, /model.2/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,160,160]) -> /model.4/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,160,160]) Layer(CaskConvolution): model.4.conv.weight + /model.4/conv/_weight_quantizer/QuantizeLinear + /model.4/conv/Conv + PWN(/model.4/act/LeakyRelu), Tactic: 0xb35096a016bb733a, /model.4/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,160,160]) -> /model.5/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,160,160]) Layer(CaskConvolution): model.5.conv.weight + /model.5/conv/_weight_quantizer/QuantizeLinear + /model.5/conv/Conv + PWN(/model.5/act/LeakyRelu), Tactic: 0xb35096a016bb733a, /model.5/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,160,160]) -> /model.7/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,160,160]) Layer(Reformat): /model.5/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.5/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,160,160]) -> /model.7/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,160,160]) Layer(Reformat): /model.4/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.4/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,160,160]) -> /model.7/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,160,160]) Layer(CaskConvolution): model.7.conv.weight + /model.7/conv/_weight_quantizer/QuantizeLinear + /model.7/conv/Conv + PWN(/model.7/act/LeakyRelu), Tactic: 0x0779fa4ac8f9f2ee, /model.7/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,160,160]) -> /model.8/m/MaxPool_output_0 (Int8[1,64:32,160,160]) Layer(CaskPooling): /model.8/m/MaxPool, Tactic: 0x94215b398b8eb3ba, /model.8/m/MaxPool_output_0 (Int8[1,64:32,160,160]) -> /model.9/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) Layer(CaskConvolution): model.9.conv.weight + /model.9/conv/_weight_quantizer/QuantizeLinear + /model.9/conv/Conv + PWN(/model.9/act/LeakyRelu), Tactic: 0x25bf7139bbd93bc8, /model.9/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) -> /model.14/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) Layer(CaskConvolution): model.10.conv.weight + /model.10/conv/_weight_quantizer/QuantizeLinear + /model.10/conv/Conv + PWN(/model.10/act/LeakyRelu), Tactic: 0x25bf7139bbd93bc8, /model.9/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) -> /model.11/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) Layer(CaskConvolution): model.11.conv.weight + /model.11/conv/_weight_quantizer/QuantizeLinear + /model.11/conv/Conv + PWN(/model.11/act/LeakyRelu), Tactic: 0xfbcd5a1da537e27f, /model.11/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) -> /model.12/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) Layer(CaskConvolution): model.12.conv.weight + /model.12/conv/_weight_quantizer/QuantizeLinear + /model.12/conv/Conv + PWN(/model.12/act/LeakyRelu), Tactic: 0xfbcd5a1da537e27f, /model.12/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) -> /model.14/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) Layer(Reformat): /model.12/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.12/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) -> /model.14/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) Layer(Reformat): /model.11/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.11/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) -> /model.14/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) Layer(CaskJitConv): model.14.conv.weight + /model.14/conv/_weight_quantizer/QuantizeLinear + /model.14/conv/Conv + PWN(/model.14/act/LeakyRelu), Tactic: 0x4f35593c356e2e7e, /model.14/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,80,80]) -> /model.14/act/LeakyRelu_output_0 (Half[1,128:32,80,80]) Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to /model.15/m/MaxPool, Tactic: 0x0000000000000000, /model.14/act/LeakyRelu_output_0 (Half[1,128:32,80,80]) -> Reformatted Input Tensor 0 to /model.15/m/MaxPool (Half[1,128:2,80,80]) Layer(CaskPooling): /model.15/m/MaxPool, Tactic: 0xc8ae100b63fd8921, Reformatted Input Tensor 0 to /model.15/m/MaxPool (Half[1,128:2,80,80]) -> /model.15/m/MaxPool_output_0 (Half[1,128:2,40,40]) Layer(Reformat): /model.50/conv/_input_quantizer/QuantizeLinear, Tactic: 0x00000000000003ea, /model.14/act/LeakyRelu_output_0 (Half[1,128:32,80,80]) -> /model.50/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,80,80]) Layer(Reformat): /model.16/conv/_input_quantizer/QuantizeLinear, Tactic: 0x00000000000003e8, /model.15/m/MaxPool_output_0 (Half[1,128:2,40,40]) -> /model.16/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) Layer(Reformat): /model.17/conv/_input_quantizer/QuantizeLinear, Tactic: 0x00000000000003e8, /model.15/m/MaxPool_output_0 (Half[1,128:2,40,40]) -> /model.17/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) Layer(CaskConvolution): model.50.conv.weight + /model.50/conv/_weight_quantizer/QuantizeLinear + /model.50/conv/Conv + PWN(/model.50/act/LeakyRelu), Tactic: 0x25bf7139bbd93bc8, /model.50/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,80,80]) -> /model.52/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) Layer(CaskConvolution): model.16.conv.weight + /model.16/conv/_weight_quantizer/QuantizeLinear + /model.16/conv/Conv + PWN(/model.16/act/LeakyRelu), Tactic: 0xace5d20e37ef6496, /model.16/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) -> /model.21/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) Layer(CaskConvolution): model.17.conv.weight + /model.17/conv/_weight_quantizer/QuantizeLinear + /model.17/conv/Conv + PWN(/model.17/act/LeakyRelu), Tactic: 0xace5d20e37ef6496, /model.17/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) -> /model.18/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) Layer(CaskConvolution): model.18.conv.weight + /model.18/conv/_weight_quantizer/QuantizeLinear + /model.18/conv/Conv + PWN(/model.18/act/LeakyRelu), Tactic: 0x5e921a04a7b0e583, /model.18/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) -> /model.19/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) Layer(CaskConvolution): model.19.conv.weight + /model.19/conv/_weight_quantizer/QuantizeLinear + /model.19/conv/Conv + PWN(/model.19/act/LeakyRelu), Tactic: 0x5e921a04a7b0e583, /model.19/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) -> /model.21/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) Layer(Reformat): /model.19/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.19/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) -> /model.21/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) Layer(Reformat): /model.18/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.18/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) -> /model.21/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) Layer(CaskJitConv): model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu), Tactic: 0x3ffcb62b1c6bb94f, /model.21/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,512:32,40,40]) -> Reformatted Output Tensor 0 to model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (Half[1,256:32,40,40]) Layer(Reformat): Reformatting CopyNode for Output Tensor 0 to model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu), Tactic: 0x0000000000000000, Reformatted Output Tensor 0 to model.21.conv.weight + /model.21/conv/_weight_quantizer/QuantizeLinear + /model.21/conv/Conv + PWN(/model.21/act/LeakyRelu) (Half[1,256:32,40,40]) -> /model.21/act/LeakyRelu_output_0 (Half[1,256:2,40,40]) Layer(CaskPooling): /model.22/m/MaxPool, Tactic: 0xc8ae100b63fd8921, /model.21/act/LeakyRelu_output_0 (Half[1,256:2,40,40]) -> /model.22/m/MaxPool_output_0 (Half[1,256:2,20,20]) Layer(Reformat): /model.40/conv/_input_quantizer/QuantizeLinear, Tactic: 0x00000000000003ea, /model.21/act/LeakyRelu_output_0 (Half[1,256:2,40,40]) -> /model.40/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,40,40]) Layer(Reformat): /model.23/conv/_input_quantizer/QuantizeLinear, Tactic: 0x00000000000003e8, /model.22/m/MaxPool_output_0 (Half[1,256:2,20,20]) -> /model.23/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(Reformat): /model.24/conv/_input_quantizer/QuantizeLinear, Tactic: 0x00000000000003e8, /model.22/m/MaxPool_output_0 (Half[1,256:2,20,20]) -> /model.24/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(CaskConvolution): model.40.conv.weight + /model.40/conv/_weight_quantizer/QuantizeLinear + /model.40/conv/Conv + PWN(/model.40/act/LeakyRelu), Tactic: 0xace5d20e37ef6496, /model.40/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,40,40]) -> /model.42/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) Layer(CaskConvolution): model.23.conv.weight + /model.23/conv/_weight_quantizer/QuantizeLinear + /model.23/conv/Conv + PWN(/model.23/act/LeakyRelu), Tactic: 0x0779fa4ac8f9f2ee, /model.23/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) -> /model.28/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(CaskConvolution): model.24.conv.weight + /model.24/conv/_weight_quantizer/QuantizeLinear + /model.24/conv/Conv + PWN(/model.24/act/LeakyRelu), Tactic: 0x4862d9a1cd4ec818, /model.24/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) -> /model.25/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(CaskConvolution): model.25.conv.weight + /model.25/conv/_weight_quantizer/QuantizeLinear + /model.25/conv/Conv + PWN(/model.25/act/LeakyRelu), Tactic: 0x83caf00de690c0ec, /model.25/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) -> /model.26/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(CaskConvolution): model.26.conv.weight + /model.26/conv/_weight_quantizer/QuantizeLinear + /model.26/conv/Conv + PWN(/model.26/act/LeakyRelu), Tactic: 0x83caf00de690c0ec, /model.26/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) -> /model.28/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(Reformat): /model.26/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.26/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) -> /model.28/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(Reformat): /model.25/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.25/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) -> /model.28/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(CaskConvolution): model.28.conv.weight + /model.28/conv/_weight_quantizer/QuantizeLinear + /model.28/conv/Conv + PWN(/model.28/act/LeakyRelu), Tactic: 0x4df7e35b8de312d7, /model.28/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,1024:32,20,20]) -> /model.29/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,512:32,20,20]) Layer(CaskConvolution): model.29.conv.weight + /model.29/conv/_weight_quantizer/QuantizeLinear + /model.29/conv/Conv + PWN(/model.29/act/LeakyRelu), Tactic: 0x4862d9a1cd4ec818, /model.29/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,512:32,20,20]) -> /model.37/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(CaskConvolution): model.30.conv.weight + /model.30/conv/_weight_quantizer/QuantizeLinear + /model.30/conv/Conv + PWN(/model.30/act/LeakyRelu), Tactic: 0x4862d9a1cd4ec818, /model.29/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,512:32,20,20]) -> /model.31/m/MaxPool_output_0 (Int8[1,256:32,20,20]) Layer(CaskPooling): /model.31/m/MaxPool, Tactic: 0x94215b398b8eb3ba, /model.31/m/MaxPool_output_0 (Int8[1,256:32,20,20]) -> /model.35/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(CaskPooling): /model.32/m/MaxPool, Tactic: 0x94215b398b8eb3ba, /model.31/m/MaxPool_output_0 (Int8[1,256:32,20,20]) -> /model.35/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(CaskPooling): /model.33/m/MaxPool, Tactic: 0x94215b398b8eb3ba, /model.31/m/MaxPool_output_0 (Int8[1,256:32,20,20]) -> /model.35/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(Reformat): /model.31/m/MaxPool_output_0 copy, Tactic: 0x0000000000000000, /model.31/m/MaxPool_output_0 (Int8[1,256:32,20,20]) -> /model.35/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(CaskConvolution): model.35.conv.weight + /model.35/conv/_weight_quantizer/QuantizeLinear + /model.35/conv/Conv + PWN(/model.35/act/LeakyRelu), Tactic: 0x6eb8c2607f51ccff, /model.35/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,1024:32,20,20]) -> /model.37/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(CaskJitConv): model.37.conv.weight + /model.37/conv/_weight_quantizer/QuantizeLinear + /model.37/conv/Conv + PWN(/model.37/act/LeakyRelu), Tactic: 0x31de506085a332d4, /model.37/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,512:32,20,20]) -> /model.67/Concat_output_0 (Half[1,256:32,20,20]) Layer(Reformat): /model.38/conv/_input_quantizer/QuantizeLinear, Tactic: 0x0000000000000000, /model.67/Concat_output_0 (Half[1,256:32,20,20]) -> /model.38/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(CaskConvolution): model.38.conv.weight + /model.38/conv/_weight_quantizer/QuantizeLinear + /model.38/conv/Conv + PWN(/model.38/act/LeakyRelu), Tactic: 0xeb1602207b0c3d49, /model.38/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) -> /model.39/Resize_output_0 (Int8[1,128:32,20,20]) Layer(Resize): /model.39/Resize, Tactic: 0x0000000000000005, /model.39/Resize_output_0 (Int8[1,128:32,20,20]) -> /model.41/Concat_/model.39/Resize_output_0_clone_1 (Int8[1,128:32,40,40]) Layer(Reformat): /model.41/Concat_/model.39/Resize_output_0_clone_1 copy, Tactic: 0x0000000000000000, /model.41/Concat_/model.39/Resize_output_0_clone_1 (Int8[1,128:32,40,40]) -> /model.42/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) Layer(CaskConvolution): model.42.conv.weight + /model.42/conv/_weight_quantizer/QuantizeLinear + /model.42/conv/Conv + PWN(/model.42/act/LeakyRelu), Tactic: 0x0779fa4ac8f9f2ee, /model.42/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,40,40]) -> /model.47/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) Layer(CaskConvolution): model.43.conv.weight + /model.43/conv/_weight_quantizer/QuantizeLinear + /model.43/conv/Conv + PWN(/model.43/act/LeakyRelu), Tactic: 0x0779fa4ac8f9f2ee, /model.42/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,40,40]) -> /model.44/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) Layer(CaskConvolution): model.44.conv.weight + /model.44/conv/_weight_quantizer/QuantizeLinear + /model.44/conv/Conv + PWN(/model.44/act/LeakyRelu), Tactic: 0xa085d13614221ec4, /model.44/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) -> /model.45/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) Layer(CaskConvolution): model.45.conv.weight + /model.45/conv/_weight_quantizer/QuantizeLinear + /model.45/conv/Conv + PWN(/model.45/act/LeakyRelu), Tactic: 0x5e921a04a7b0e583, /model.45/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) -> /model.47/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) Layer(Reformat): /model.45/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.45/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) -> /model.47/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) Layer(Reformat): /model.44/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.44/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) -> /model.47/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) Layer(CaskJitConv): model.47.conv.weight + /model.47/conv/_weight_quantizer/QuantizeLinear + /model.47/conv/Conv + PWN(/model.47/act/LeakyRelu), Tactic: 0xc22b2f91e37e472a, /model.47/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,40,40]) -> /model.59/Concat_output_0 (Half[1,128:32,40,40]) Layer(Reformat): /model.48/conv/_input_quantizer/QuantizeLinear, Tactic: 0x00000000000003e8, /model.59/Concat_output_0 (Half[1,128:32,40,40]) -> /model.48/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) Layer(CaskConvolution): model.48.conv.weight + /model.48/conv/_weight_quantizer/QuantizeLinear + /model.48/conv/Conv + PWN(/model.48/act/LeakyRelu), Tactic: 0x4862d9a1cd4ec818, /model.48/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) -> /model.49/Resize_output_0 (Int8[1,64:32,40,40]) Layer(Resize): /model.49/Resize, Tactic: 0x0000000000000005, /model.49/Resize_output_0 (Int8[1,64:32,40,40]) -> /model.51/Concat_/model.49/Resize_output_0_clone_1 (Int8[1,64:32,80,80]) Layer(Reformat): /model.51/Concat_/model.49/Resize_output_0_clone_1 copy, Tactic: 0x0000000000000000, /model.51/Concat_/model.49/Resize_output_0_clone_1 (Int8[1,64:32,80,80]) -> /model.52/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) Layer(CaskConvolution): model.52.conv.weight + /model.52/conv/_weight_quantizer/QuantizeLinear + /model.52/conv/Conv + PWN(/model.52/act/LeakyRelu), Tactic: 0xa40d21cb7ebb07bf, /model.52/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,80,80]) -> /model.57/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,80,80]) Layer(CaskConvolution): model.53.conv.weight + /model.53/conv/_weight_quantizer/QuantizeLinear + /model.53/conv/Conv + PWN(/model.53/act/LeakyRelu), Tactic: 0xa40d21cb7ebb07bf, /model.52/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,80,80]) -> /model.54/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,80,80]) Layer(CaskConvolution): model.54.conv.weight + /model.54/conv/_weight_quantizer/QuantizeLinear + /model.54/conv/Conv + PWN(/model.54/act/LeakyRelu), Tactic: 0x5e921a04a7b0e583, /model.54/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,80,80]) -> /model.55/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,80,80]) Layer(CaskConvolution): model.55.conv.weight + /model.55/conv/_weight_quantizer/QuantizeLinear + /model.55/conv/Conv + PWN(/model.55/act/LeakyRelu), Tactic: 0x5e921a04a7b0e583, /model.55/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,80,80]) -> /model.57/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,80,80]) Layer(Reformat): /model.55/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.55/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,80,80]) -> /model.57/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,80,80]) Layer(Reformat): /model.54/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.54/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,80,80]) -> /model.57/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,32:32,80,80]) Layer(CaskConvolution): model.57.conv.weight + /model.57/conv/_weight_quantizer/QuantizeLinear + /model.57/conv/Conv + PWN(/model.57/act/LeakyRelu), Tactic: 0x25bf7139bbd93bc8, /model.57/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,80,80]) -> /model.58/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) Layer(CaskJitConv): model.58.conv.weight + /model.58/conv/_weight_quantizer/QuantizeLinear + /model.58/conv/Conv + PWN(/model.58/act/LeakyRelu), Tactic: 0xbb88763c3b0e94d4, /model.58/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) -> /model.59/Concat_output_0 (Half[1,128:32,40,40]) Layer(CaskConvolution): model.74.conv.weight + /model.74/conv/_weight_quantizer/QuantizeLinear + /model.74/conv/Conv + PWN(/model.74/act/LeakyRelu), Tactic: 0xa085d13614221ec4, /model.58/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,80,80]) -> /model.77/m.0/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,80,80]) Layer(Reformat): /model.60/conv/_input_quantizer/QuantizeLinear, Tactic: 0x00000000000003ea, /model.59/Concat_output_0 (Half[1,256:32,40,40]) -> /model.60/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,40,40]) Layer(Reformat): /model.61/conv/_input_quantizer/QuantizeLinear, Tactic: 0x00000000000003e8, /model.59/Concat_output_0 (Half[1,256:32,40,40]) -> /model.61/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,40,40]) Layer(CaskConvolution): model.77.m.0.weight + /model.77/m.0/_weight_quantizer/QuantizeLinear + /model.77/m.0/Conv, Tactic: 0x733ba2a91a48d431, /model.77/m.0/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,80,80]) -> /model.77/m.0/Conv_output_0 (Float[1,255,80,80]) Layer(CaskConvolution): model.60.conv.weight + /model.60/conv/_weight_quantizer/QuantizeLinear + /model.60/conv/Conv + PWN(/model.60/act/LeakyRelu), Tactic: 0x0779fa4ac8f9f2ee, /model.60/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,40,40]) -> /model.65/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) Layer(CaskConvolution): model.61.conv.weight + /model.61/conv/_weight_quantizer/QuantizeLinear + /model.61/conv/Conv + PWN(/model.61/act/LeakyRelu), Tactic: 0x0779fa4ac8f9f2ee, /model.61/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,40,40]) -> /model.62/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) Layer(PointWiseV2): PWN(/model.77/Sigmoid), Tactic: 0x0000000000000009, /model.77/m.0/Conv_output_0 (Float[1,255,80,80]) -> /model.77/Transpose_output_0 (Half[1,255,80,80]) Layer(Shuffle): /model.77/Reshape + /model.77/Transpose, Tactic: 0x0000000000000000, /model.77/Transpose_output_0 (Half[1,255,80,80]) -> /model.77/Sigmoid_output_0 (Half[1,3,80,80,85]) Layer(Slice): /model.77/Split, Tactic: 0x0000000000000000, /model.77/Sigmoid_output_0 (Half[1,3,80,80,85]) -> /model.77/Split_output_0 (Half[1,3,80,80,2]) Layer(Slice): /model.77/Split_110, Tactic: 0x0000000000000000, /model.77/Sigmoid_output_0 (Half[1,3,80,80,85]) -> /model.77/Split_output_1 (Half[1,3,80,80,2]) Layer(Slice): /model.77/Split_111, Tactic: 0x0000000000000000, /model.77/Sigmoid_output_0 (Half[1,3,80,80,85]) -> /model.77/Concat_output_0 (Half[1,3,80,80,81]) Layer(CaskConvolution): model.62.conv.weight + /model.62/conv/_weight_quantizer/QuantizeLinear + /model.62/conv/Conv + PWN(/model.62/act/LeakyRelu), Tactic: 0xa085d13614221ec4, /model.62/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) -> /model.63/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) Layer(PointWiseV2): PWN(/model.77/Constant_1_output_0 + (Unnamed Layer* 632) [Shuffle] + /model.77/Mul, /model.77/Add), Tactic: 0x0000000000000002, /model.77/Split_output_0 (Half[1,3,80,80,2]), (Unnamed Layer* 634) [Constant]_output (Half[1,1,80,80,2]) -> /model.77/Add_output_0 (Half[1,3,80,80,2]) Layer(PointWiseV2): PWN(PWN(/model.77/Constant_3_output_0 + (Unnamed Layer* 637) [Shuffle], /model.77/Pow), /model.77/Mul_1), Tactic: 0x000000000000001c, /model.77/Split_output_1 (Half[1,3,80,80,2]), (Unnamed Layer* 639) [Constant]_output (Half[1,3,1,1,2]) -> /model.77/Mul_1_output_0 (Float[1,3,80,80,2]) Layer(Reformat): /model.77/Add_output_0 copy, Tactic: 0x00000000000003e8, /model.77/Add_output_0 (Half[1,3,80,80,2]) -> /model.77/Concat_output_0 (Half[1,3,80,80,2]) Layer(Reformat): /model.77/Mul_1_output_0 copy, Tactic: 0x00000000000003e8, /model.77/Mul_1_output_0 (Float[1,3,80,80,2]) -> /model.77/Concat_output_0 (Half[1,3,80,80,2]) Layer(NoOp): /model.77/Reshape_1, Tactic: 0x0000000000000000, /model.77/Concat_output_0 (Half[1,3,80,80,85]) -> /model.77/Reshape_1_copy_output (Half[1,19200,85]) Layer(Reformat): /model.77/Reshape_1_copy_output, Tactic: 0x0000000000000000, /model.77/Reshape_1_copy_output (Half[1,19200,85]) -> outputs (Float[1,19200,85]) Layer(CaskConvolution): model.63.conv.weight + /model.63/conv/_weight_quantizer/QuantizeLinear + /model.63/conv/Conv + PWN(/model.63/act/LeakyRelu), Tactic: 0x5e921a04a7b0e583, /model.63/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) -> /model.65/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) Layer(Reformat): /model.63/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.63/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) -> /model.65/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) Layer(Reformat): /model.62/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.62/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) -> /model.65/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,64:32,40,40]) Layer(CaskConvolution): model.65.conv.weight + /model.65/conv/_weight_quantizer/QuantizeLinear + /model.65/conv/Conv + PWN(/model.65/act/LeakyRelu), Tactic: 0xace5d20e37ef6496, /model.65/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,40,40]) -> /model.66/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) Layer(CaskJitConv): model.66.conv.weight + /model.66/conv/_weight_quantizer/QuantizeLinear + /model.66/conv/Conv + PWN(/model.66/act/LeakyRelu), Tactic: 0xd3f592fae61c7986, /model.66/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) -> /model.67/Concat_output_0 (Half[1,256:32,20,20]) Layer(CaskConvolution): model.75.conv.weight + /model.75/conv/_weight_quantizer/QuantizeLinear + /model.75/conv/Conv + PWN(/model.75/act/LeakyRelu), Tactic: 0xfbcd5a1da537e27f, /model.66/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,40,40]) -> /model.77/m.1/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,40,40]) Layer(Reformat): /model.68/conv/_input_quantizer/QuantizeLinear, Tactic: 0x0000000000000000, /model.67/Concat_output_0 (Half[1,512:32,20,20]) -> /model.68/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,512:32,20,20]) Layer(Reformat): /model.69/conv/_input_quantizer/QuantizeLinear, Tactic: 0x0000000000000000, /model.67/Concat_output_0 (Half[1,512:32,20,20]) -> /model.69/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,512:32,20,20]) Layer(CaskConvolution): model.77.m.1.weight + /model.77/m.1/_weight_quantizer/QuantizeLinear + /model.77/m.1/Conv, Tactic: 0x733ba2a91a48d431, /model.77/m.1/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,40,40]) -> /model.77/m.1/Conv_output_0 (Float[1,255,40,40]) Layer(CaskConvolution): model.68.conv.weight + /model.68/conv/_weight_quantizer/QuantizeLinear + /model.68/conv/Conv + PWN(/model.68/act/LeakyRelu), Tactic: 0x90af0952ccc337b8, /model.68/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,512:32,20,20]) -> /model.73/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,20,20]) Layer(CaskConvolution): model.69.conv.weight + /model.69/conv/_weight_quantizer/QuantizeLinear + /model.69/conv/Conv + PWN(/model.69/act/LeakyRelu), Tactic: 0xeb1602207b0c3d49, /model.69/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,512:32,20,20]) -> /model.70/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,20,20]) Layer(PointWiseV2): PWN(/model.77/Sigmoid_1), Tactic: 0x0000000000000005, /model.77/m.1/Conv_output_0 (Float[1,255,40,40]) -> /model.77/Transpose_1_output_0 (Half[1,255,40,40]) Layer(Shuffle): /model.77/Reshape_2 + /model.77/Transpose_1, Tactic: 0x0000000000000000, /model.77/Transpose_1_output_0 (Half[1,255,40,40]) -> /model.77/Sigmoid_1_output_0 (Half[1,3,40,40,85]) Layer(Slice): /model.77/Split_1, Tactic: 0x0000000000000000, /model.77/Sigmoid_1_output_0 (Half[1,3,40,40,85]) -> /model.77/Split_1_output_0 (Half[1,3,40,40,2]) Layer(Slice): /model.77/Split_1_116, Tactic: 0x0000000000000000, /model.77/Sigmoid_1_output_0 (Half[1,3,40,40,85]) -> /model.77/Split_1_output_1 (Half[1,3,40,40,2]) Layer(Slice): /model.77/Split_1_117, Tactic: 0x0000000000000000, /model.77/Sigmoid_1_output_0 (Half[1,3,40,40,85]) -> /model.77/Concat_1_output_0 (Half[1,3,40,40,81]) Layer(CaskConvolution): model.70.conv.weight + /model.70/conv/_weight_quantizer/QuantizeLinear + /model.70/conv/Conv + PWN(/model.70/act/LeakyRelu), Tactic: 0x7ddd3b3f55023bab, /model.70/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,20,20]) -> /model.71/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,20,20]) Layer(PointWiseV2): PWN(/model.77/Constant_7_output_0 + (Unnamed Layer* 660) [Shuffle] + /model.77/Mul_2, /model.77/Add_1), Tactic: 0x000000000000001c, /model.77/Split_1_output_0 (Half[1,3,40,40,2]), (Unnamed Layer* 662) [Constant]_output (Half[1,1,40,40,2]) -> /model.77/Add_1_output_0 (Float[1,3,40,40,2]) Layer(PointWiseV2): PWN(PWN(/model.77/Constant_9_output_0 + (Unnamed Layer* 665) [Shuffle], /model.77/Pow_1), /model.77/Mul_3), Tactic: 0x000000000000001c, /model.77/Split_1_output_1 (Half[1,3,40,40,2]), (Unnamed Layer* 667) [Constant]_output (Half[1,3,1,1,2]) -> /model.77/Mul_3_output_0 (Half[1,3,40,40,2]) Layer(Reformat): /model.77/Add_1_output_0 copy, Tactic: 0x00000000000003e8, /model.77/Add_1_output_0 (Float[1,3,40,40,2]) -> /model.77/Concat_1_output_0 (Half[1,3,40,40,2]) Layer(Reformat): /model.77/Mul_3_output_0 copy, Tactic: 0x00000000000003e8, /model.77/Mul_3_output_0 (Half[1,3,40,40,2]) -> /model.77/Concat_1_output_0 (Half[1,3,40,40,2]) Layer(NoOp): /model.77/Reshape_3, Tactic: 0x0000000000000000, /model.77/Concat_1_output_0 (Half[1,3,40,40,85]) -> /model.77/Reshape_3_copy_output (Half[1,4800,85]) Layer(Reformat): /model.77/Reshape_3_copy_output, Tactic: 0x00000000000003e8, /model.77/Reshape_3_copy_output (Half[1,4800,85]) -> outputs (Float[1,4800,85]) Layer(CaskConvolution): model.71.conv.weight + /model.71/conv/_weight_quantizer/QuantizeLinear + /model.71/conv/Conv + PWN(/model.71/act/LeakyRelu), Tactic: 0x7ddd3b3f55023bab, /model.71/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,20,20]) -> /model.73/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,20,20]) Layer(Reformat): /model.71/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.71/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,20,20]) -> /model.73/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,20,20]) Layer(Reformat): /model.70/conv/_input_quantizer/QuantizeLinear_output_0 copy, Tactic: 0x0000000000000000, /model.70/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,20,20]) -> /model.73/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,128:32,20,20]) Layer(CaskConvolution): model.73.conv.weight + /model.73/conv/_weight_quantizer/QuantizeLinear + /model.73/conv/Conv + PWN(/model.73/act/LeakyRelu), Tactic: 0x4862d9a1cd4ec818, /model.73/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,512:32,20,20]) -> /model.76/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) Layer(CaskConvolution): model.76.conv.weight + /model.76/conv/_weight_quantizer/QuantizeLinear + /model.76/conv/Conv + PWN(/model.76/act/LeakyRelu), Tactic: 0xa085d13614221ec4, /model.76/conv/_input_quantizer/QuantizeLinear_output_0 (Int8[1,256:32,20,20]) -> /model.77/m.2/_input_quantizer/QuantizeLinear_output_0 (Int8[1,512:32,20,20]) Layer(CaskConvolution): model.77.m.2.weight + /model.77/m.2/_weight_quantizer/QuantizeLinear + /model.77/m.2/Conv, Tactic: 0x5e4f6d7c83746fd6, /model.77/m.2/_input_quantizer/QuantizeLinear_output_0 (Int8[1,512:32,20,20]) -> /model.77/m.2/Conv_output_0 (Float[1,255,20,20]) Layer(PointWiseV2): PWN(/model.77/Sigmoid_2), Tactic: 0x0000000000000005, /model.77/m.2/Conv_output_0 (Float[1,255,20,20]) -> /model.77/Transpose_2_output_0 (Half[1,255,20,20]) Layer(Shuffle): /model.77/Reshape_4 + /model.77/Transpose_2, Tactic: 0x0000000000000000, /model.77/Transpose_2_output_0 (Half[1,255,20,20]) -> /model.77/Sigmoid_2_output_0 (Half[1,3,20,20,85]) Layer(Slice): /model.77/Split_2, Tactic: 0x0000000000000000, /model.77/Sigmoid_2_output_0 (Half[1,3,20,20,85]) -> /model.77/Split_2_output_0 (Half[1,3,20,20,2]) Layer(Slice): /model.77/Split_2_122, Tactic: 0x0000000000000000, /model.77/Sigmoid_2_output_0 (Half[1,3,20,20,85]) -> /model.77/Split_2_output_1 (Half[1,3,20,20,2]) Layer(Slice): /model.77/Split_2_123, Tactic: 0x0000000000000000, /model.77/Sigmoid_2_output_0 (Half[1,3,20,20,85]) -> /model.77/Concat_2_output_0 (Half[1,3,20,20,81]) Layer(Constant): /model.77/Constant_14_output_0, Tactic: 0x0000000000000000, -> (Unnamed Layer* 690) [Constant]_output (Half[1,1,20,20,2]) Layer(PointWiseV2): PWN(/model.77/Constant_13_output_0 + (Unnamed Layer* 688) [Shuffle] + /model.77/Mul_4, /model.77/Add_2), Tactic: 0x0000000000000000, /model.77/Split_2_output_0 (Half[1,3,20,20,2]), (Unnamed Layer* 690) [Constant]_output (Half[1,1,20,20,2]) -> /model.77/Add_2_output_0 (Float[1,3,20,20,2]) Layer(Constant): /model.77/Constant_16_output_0, Tactic: 0x0000000000000000, -> (Unnamed Layer* 695) [Constant]_output (Half[1,3,1,1,2]) Layer(PointWiseV2): PWN(PWN(/model.77/Constant_15_output_0 + (Unnamed Layer* 693) [Shuffle], /model.77/Pow_2), /model.77/Mul_5), Tactic: 0x0000000000000000, /model.77/Split_2_output_1 (Half[1,3,20,20,2]), (Unnamed Layer* 695) [Constant]_output (Half[1,3,1,1,2]) -> /model.77/Mul_5_output_0 (Float[1,3,20,20,2]) Layer(Reformat): /model.77/Add_2_output_0 copy, Tactic: 0x00000000000003e8, /model.77/Add_2_output_0 (Float[1,3,20,20,2]) -> /model.77/Concat_2_output_0 (Half[1,3,20,20,2]) Layer(Reformat): /model.77/Mul_5_output_0 copy, Tactic: 0x00000000000003e8, /model.77/Mul_5_output_0 (Float[1,3,20,20,2]) -> /model.77/Concat_2_output_0 (Half[1,3,20,20,2]) Layer(NoOp): /model.77/Reshape_5, Tactic: 0x0000000000000000, /model.77/Concat_2_output_0 (Half[1,3,20,20,85]) -> /model.77/Reshape_5_copy_output (Half[1,1200,85]) Layer(Reformat): /model.77/Reshape_5_copy_output, Tactic: 0x00000000000003e8, /model.77/Reshape_5_copy_output (Half[1,1200,85]) -> outputs (Float[1,1200,85]) [04/18/2023-18:36:45] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in building engine: CPU +6, GPU +7, now: CPU 6, GPU 7 (MiB) [04/18/2023-18:36:45] [I] Engine built in 327.939 sec. [04/18/2023-18:36:45] [I] [TRT] Loaded engine size: 8 MiB [04/18/2023-18:36:45] [V] [TRT] Deserialization required 20182 microseconds. [04/18/2023-18:36:45] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +6, now: CPU 0, GPU 6 (MiB) [04/18/2023-18:36:45] [I] Engine deserialized in 0.0204182 sec. [04/18/2023-18:36:45] [V] [TRT] Total per-runner device persistent memory is 614912 [04/18/2023-18:36:45] [V] [TRT] Total per-runner host persistent memory is 190272 [04/18/2023-18:36:45] [V] [TRT] Allocated activation device memory of size 21939200 [04/18/2023-18:36:45] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +22, now: CPU 0, GPU 28 (MiB) [04/18/2023-18:36:45] [V] [TRT] CUDA lazy loading is enabled. [04/18/2023-18:36:45] [I] Setting persistentCacheLimit to 0 bytes. [04/18/2023-18:36:45] [V] Using enqueueV3. [04/18/2023-18:36:45] [I] Using random values for input images [04/18/2023-18:36:45] [I] Created input binding for images with dimensions 1x3x640x640 [04/18/2023-18:36:45] [I] Using random values for output outputs [04/18/2023-18:36:45] [I] Created output binding for outputs with dimensions 1x25200x85 [04/18/2023-18:36:45] [I] Starting inference [04/18/2023-18:36:48] [I] Warmup completed 180 queries over 200 ms [04/18/2023-18:36:48] [I] Timing trace has 2703 queries over 3.00327 s [04/18/2023-18:36:48] [I] [04/18/2023-18:36:48] [I] === Trace details === [04/18/2023-18:36:48] [I] Trace averages of 10 runs: [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.718338 ms - Host latency: 1.98326 ms (enqueue 0.095369 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.705641 ms - Host latency: 1.97246 ms (enqueue 0.0784836 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.712808 ms - Host latency: 1.97934 ms (enqueue 0.0903 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.701953 ms - Host latency: 1.97067 ms (enqueue 0.0904053 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.70482 ms - Host latency: 1.96033 ms (enqueue 0.0964142 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.696832 ms - Host latency: 1.96822 ms (enqueue 0.0966949 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.674918 ms - Host latency: 1.9471 ms (enqueue 0.0936066 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.678503 ms - Host latency: 1.94027 ms (enqueue 0.094696 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.692938 ms - Host latency: 1.96841 ms (enqueue 0.0858582 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.675745 ms - Host latency: 1.9577 ms (enqueue 0.0909363 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.675226 ms - Host latency: 1.94898 ms (enqueue 0.10538 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.675635 ms - Host latency: 1.94254 ms (enqueue 0.100372 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.67594 ms - Host latency: 1.94281 ms (enqueue 0.106308 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.674716 ms - Host latency: 1.94 ms (enqueue 0.103488 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.676343 ms - Host latency: 1.9402 ms (enqueue 0.105841 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.68291 ms - Host latency: 1.95473 ms (enqueue 0.106723 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.677579 ms - Host latency: 1.93919 ms (enqueue 0.102164 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.691406 ms - Host latency: 1.96296 ms (enqueue 0.10502 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.677576 ms - Host latency: 1.95163 ms (enqueue 0.0959991 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.677075 ms - Host latency: 1.93979 ms (enqueue 0.100702 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681677 ms - Host latency: 1.96163 ms (enqueue 0.0983734 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681067 ms - Host latency: 1.95338 ms (enqueue 0.0959869 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.677277 ms - Host latency: 1.9593 ms (enqueue 0.0979401 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.678604 ms - Host latency: 1.95616 ms (enqueue 0.0989899 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.677997 ms - Host latency: 1.95089 ms (enqueue 0.0973633 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.674609 ms - Host latency: 1.94754 ms (enqueue 0.0949707 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.694983 ms - Host latency: 1.96666 ms (enqueue 0.0952209 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682562 ms - Host latency: 1.95172 ms (enqueue 0.086554 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.678088 ms - Host latency: 1.98278 ms (enqueue 0.0938049 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.67594 ms - Host latency: 1.93758 ms (enqueue 0.0875244 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.674524 ms - Host latency: 1.94332 ms (enqueue 0.0877197 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.678467 ms - Host latency: 1.94557 ms (enqueue 0.0838928 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.675629 ms - Host latency: 1.94501 ms (enqueue 0.0925476 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.676361 ms - Host latency: 1.94611 ms (enqueue 0.0913208 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.684259 ms - Host latency: 1.94993 ms (enqueue 0.0837769 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.677173 ms - Host latency: 1.95779 ms (enqueue 0.0843384 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.678723 ms - Host latency: 1.94873 ms (enqueue 0.0883423 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.674713 ms - Host latency: 1.92352 ms (enqueue 0.0872742 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.677478 ms - Host latency: 1.93571 ms (enqueue 0.0843445 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.677679 ms - Host latency: 1.94036 ms (enqueue 0.0862488 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.676141 ms - Host latency: 1.93089 ms (enqueue 0.0888184 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.679095 ms - Host latency: 1.95044 ms (enqueue 0.0841064 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.675116 ms - Host latency: 1.95098 ms (enqueue 0.0873474 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.676349 ms - Host latency: 1.93798 ms (enqueue 0.0838684 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.677185 ms - Host latency: 1.94744 ms (enqueue 0.0854553 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.674207 ms - Host latency: 1.92814 ms (enqueue 0.093573 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.674512 ms - Host latency: 1.93087 ms (enqueue 0.0894104 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.675623 ms - Host latency: 1.94787 ms (enqueue 0.0912415 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.676654 ms - Host latency: 1.95464 ms (enqueue 0.0987732 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.675433 ms - Host latency: 1.94439 ms (enqueue 0.101599 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.67677 ms - Host latency: 1.95474 ms (enqueue 0.101093 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.677997 ms - Host latency: 1.94352 ms (enqueue 0.0986145 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.677173 ms - Host latency: 1.9453 ms (enqueue 0.103937 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.676849 ms - Host latency: 1.93359 ms (enqueue 0.0985229 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.678809 ms - Host latency: 1.94339 ms (enqueue 0.105231 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.677484 ms - Host latency: 1.94464 ms (enqueue 0.0991211 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.677673 ms - Host latency: 1.95027 ms (enqueue 0.0992554 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.676752 ms - Host latency: 1.94168 ms (enqueue 0.101019 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.678497 ms - Host latency: 1.94852 ms (enqueue 0.0999023 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.676849 ms - Host latency: 1.94694 ms (enqueue 0.0979858 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.675946 ms - Host latency: 1.95689 ms (enqueue 0.0977539 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.676959 ms - Host latency: 1.94984 ms (enqueue 0.0969482 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.675842 ms - Host latency: 1.94761 ms (enqueue 0.101953 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.676764 ms - Host latency: 1.93972 ms (enqueue 0.0981201 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.676666 ms - Host latency: 1.94114 ms (enqueue 0.100372 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.679108 ms - Host latency: 1.95481 ms (enqueue 0.0944641 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.677771 ms - Host latency: 1.94113 ms (enqueue 0.100085 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.675836 ms - Host latency: 1.94476 ms (enqueue 0.100171 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.67746 ms - Host latency: 1.97158 ms (enqueue 0.103247 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.686999 ms - Host latency: 1.9562 ms (enqueue 0.0997375 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.677155 ms - Host latency: 1.94027 ms (enqueue 0.103583 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.677283 ms - Host latency: 1.94575 ms (enqueue 0.098999 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.678503 ms - Host latency: 1.94528 ms (enqueue 0.0981018 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.675928 ms - Host latency: 1.93883 ms (enqueue 0.0985535 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.67627 ms - Host latency: 1.9423 ms (enqueue 0.0971191 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.677795 ms - Host latency: 1.9333 ms (enqueue 0.0987671 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.676978 ms - Host latency: 1.94521 ms (enqueue 0.104102 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.676538 ms - Host latency: 1.95272 ms (enqueue 0.102576 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.677295 ms - Host latency: 1.94744 ms (enqueue 0.086499 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.676758 ms - Host latency: 1.95376 ms (enqueue 0.0841919 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.677991 ms - Host latency: 1.93959 ms (enqueue 0.0842285 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.676355 ms - Host latency: 1.93682 ms (enqueue 0.0867676 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.678857 ms - Host latency: 1.93584 ms (enqueue 0.0872925 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.678503 ms - Host latency: 1.93801 ms (enqueue 0.0845215 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.676257 ms - Host latency: 1.9405 ms (enqueue 0.0842896 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.67594 ms - Host latency: 1.93569 ms (enqueue 0.0843994 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.679211 ms - Host latency: 1.93716 ms (enqueue 0.0841064 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.675012 ms - Host latency: 1.94143 ms (enqueue 0.0838989 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.676147 ms - Host latency: 1.99966 ms (enqueue 0.0796265 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.674939 ms - Host latency: 1.97008 ms (enqueue 0.0858032 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.679419 ms - Host latency: 1.93821 ms (enqueue 0.084082 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.676636 ms - Host latency: 1.94186 ms (enqueue 0.0849609 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.676868 ms - Host latency: 1.93331 ms (enqueue 0.0839966 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.677161 ms - Host latency: 1.95857 ms (enqueue 0.0836182 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.676648 ms - Host latency: 1.94468 ms (enqueue 0.0833008 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.677209 ms - Host latency: 1.93708 ms (enqueue 0.0833008 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.678589 ms - Host latency: 1.94943 ms (enqueue 0.083313 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.676257 ms - Host latency: 1.94744 ms (enqueue 0.0833374 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.67898 ms - Host latency: 1.94686 ms (enqueue 0.083374 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.675537 ms - Host latency: 1.94926 ms (enqueue 0.0833252 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.675549 ms - Host latency: 1.94974 ms (enqueue 0.0839111 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.675305 ms - Host latency: 1.9354 ms (enqueue 0.0740234 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.679004 ms - Host latency: 1.95024 ms (enqueue 0.0838135 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.678101 ms - Host latency: 1.94705 ms (enqueue 0.0819214 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.679114 ms - Host latency: 1.94666 ms (enqueue 0.0868652 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681824 ms - Host latency: 1.94999 ms (enqueue 0.0859131 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680542 ms - Host latency: 1.95859 ms (enqueue 0.0832642 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681299 ms - Host latency: 1.94629 ms (enqueue 0.0903564 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.68197 ms - Host latency: 1.95415 ms (enqueue 0.0813354 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.683105 ms - Host latency: 1.94906 ms (enqueue 0.0821167 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.684387 ms - Host latency: 1.94985 ms (enqueue 0.0812622 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680676 ms - Host latency: 1.94967 ms (enqueue 0.0830688 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680689 ms - Host latency: 1.95131 ms (enqueue 0.0815552 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682788 ms - Host latency: 1.94723 ms (enqueue 0.0832642 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681787 ms - Host latency: 1.948 ms (enqueue 0.0825684 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680151 ms - Host latency: 1.94803 ms (enqueue 0.0814575 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680151 ms - Host latency: 2.01926 ms (enqueue 0.0865845 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.67915 ms - Host latency: 2.06107 ms (enqueue 0.0888062 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682104 ms - Host latency: 1.95287 ms (enqueue 0.0839233 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.683044 ms - Host latency: 1.9447 ms (enqueue 0.0812378 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682092 ms - Host latency: 1.9453 ms (enqueue 0.0813721 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681677 ms - Host latency: 1.9443 ms (enqueue 0.0815796 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.683423 ms - Host latency: 1.94449 ms (enqueue 0.0819092 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681885 ms - Host latency: 1.95374 ms (enqueue 0.0894653 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680334 ms - Host latency: 1.94583 ms (enqueue 0.0819458 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.683997 ms - Host latency: 1.94739 ms (enqueue 0.0865479 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.67981 ms - Host latency: 1.94824 ms (enqueue 0.0814453 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680664 ms - Host latency: 1.95144 ms (enqueue 0.0861938 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680884 ms - Host latency: 1.94491 ms (enqueue 0.0860596 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681262 ms - Host latency: 1.94239 ms (enqueue 0.0814819 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680554 ms - Host latency: 1.94253 ms (enqueue 0.0863892 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681543 ms - Host latency: 1.94019 ms (enqueue 0.0817383 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.679211 ms - Host latency: 1.95281 ms (enqueue 0.0845703 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681897 ms - Host latency: 1.94919 ms (enqueue 0.0839111 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681775 ms - Host latency: 1.94391 ms (enqueue 0.0841064 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680933 ms - Host latency: 1.94901 ms (enqueue 0.0812256 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.68125 ms - Host latency: 1.95233 ms (enqueue 0.083252 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682275 ms - Host latency: 1.95461 ms (enqueue 0.0843262 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681396 ms - Host latency: 1.97209 ms (enqueue 0.0872681 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681543 ms - Host latency: 1.95497 ms (enqueue 0.0851196 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682996 ms - Host latency: 1.9476 ms (enqueue 0.0834351 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.684363 ms - Host latency: 1.95703 ms (enqueue 0.0936157 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680444 ms - Host latency: 1.95864 ms (enqueue 0.0866577 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681958 ms - Host latency: 1.94952 ms (enqueue 0.0865723 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682922 ms - Host latency: 1.94519 ms (enqueue 0.081311 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680505 ms - Host latency: 1.94364 ms (enqueue 0.0812988 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.683398 ms - Host latency: 1.94482 ms (enqueue 0.0819092 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682092 ms - Host latency: 1.94186 ms (enqueue 0.081189 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681165 ms - Host latency: 1.94315 ms (enqueue 0.0816284 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.683923 ms - Host latency: 1.9495 ms (enqueue 0.084082 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.68031 ms - Host latency: 1.94869 ms (enqueue 0.0854248 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.679504 ms - Host latency: 1.93987 ms (enqueue 0.0832886 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682593 ms - Host latency: 1.94969 ms (enqueue 0.0813354 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.68208 ms - Host latency: 1.94843 ms (enqueue 0.0837036 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.68114 ms - Host latency: 1.94319 ms (enqueue 0.0815186 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.68302 ms - Host latency: 1.97279 ms (enqueue 0.0878052 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.679041 ms - Host latency: 2.05214 ms (enqueue 0.0825195 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.679761 ms - Host latency: 2.06351 ms (enqueue 0.0823242 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.68031 ms - Host latency: 1.93728 ms (enqueue 0.0886841 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681372 ms - Host latency: 1.94148 ms (enqueue 0.0842163 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682312 ms - Host latency: 1.94822 ms (enqueue 0.0814941 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681897 ms - Host latency: 1.94834 ms (enqueue 0.0835815 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682446 ms - Host latency: 1.94453 ms (enqueue 0.0821899 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.6828 ms - Host latency: 1.94608 ms (enqueue 0.0911865 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682983 ms - Host latency: 1.94142 ms (enqueue 0.0815796 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681165 ms - Host latency: 1.94171 ms (enqueue 0.0812622 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.684241 ms - Host latency: 1.94492 ms (enqueue 0.0814819 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682764 ms - Host latency: 1.94531 ms (enqueue 0.0815063 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.68042 ms - Host latency: 1.94468 ms (enqueue 0.0855957 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.67981 ms - Host latency: 1.95176 ms (enqueue 0.0847412 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682788 ms - Host latency: 1.94807 ms (enqueue 0.0813232 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681348 ms - Host latency: 1.95444 ms (enqueue 0.0862793 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681689 ms - Host latency: 1.94175 ms (enqueue 0.0837891 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682397 ms - Host latency: 1.94729 ms (enqueue 0.0813721 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682788 ms - Host latency: 1.9416 ms (enqueue 0.0818603 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681543 ms - Host latency: 1.94531 ms (enqueue 0.0813965 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681348 ms - Host latency: 1.94517 ms (enqueue 0.086499 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.683374 ms - Host latency: 1.95054 ms (enqueue 0.0833496 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680054 ms - Host latency: 2.01758 ms (enqueue 0.090918 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681226 ms - Host latency: 1.97334 ms (enqueue 0.0835937 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.679858 ms - Host latency: 1.94988 ms (enqueue 0.0848633 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.68269 ms - Host latency: 1.95278 ms (enqueue 0.0846191 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.679614 ms - Host latency: 2.01741 ms (enqueue 0.0878662 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682397 ms - Host latency: 1.94976 ms (enqueue 0.0812256 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.679883 ms - Host latency: 1.99961 ms (enqueue 0.084375 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.679712 ms - Host latency: 1.95298 ms (enqueue 0.0859863 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682642 ms - Host latency: 1.96333 ms (enqueue 0.0817383 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680811 ms - Host latency: 2.00251 ms (enqueue 0.0845947 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681934 ms - Host latency: 1.98069 ms (enqueue 0.086792 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.68186 ms - Host latency: 1.95017 ms (enqueue 0.0800293 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680225 ms - Host latency: 1.95156 ms (enqueue 0.0798584 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680542 ms - Host latency: 1.95562 ms (enqueue 0.0871826 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681616 ms - Host latency: 1.95535 ms (enqueue 0.084668 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680273 ms - Host latency: 1.95457 ms (enqueue 0.0821289 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681006 ms - Host latency: 1.94839 ms (enqueue 0.08479 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.683643 ms - Host latency: 1.95874 ms (enqueue 0.0822022 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680444 ms - Host latency: 1.95181 ms (enqueue 0.0844727 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.67998 ms - Host latency: 1.95339 ms (enqueue 0.0821289 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681543 ms - Host latency: 1.95342 ms (enqueue 0.081958 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681299 ms - Host latency: 1.95229 ms (enqueue 0.0821777 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680615 ms - Host latency: 1.95476 ms (enqueue 0.0820557 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681128 ms - Host latency: 1.95017 ms (enqueue 0.0824951 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680884 ms - Host latency: 1.95715 ms (enqueue 0.0821777 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682031 ms - Host latency: 1.95413 ms (enqueue 0.0821533 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.68269 ms - Host latency: 1.95771 ms (enqueue 0.089209 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681982 ms - Host latency: 1.95728 ms (enqueue 0.0879883 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681055 ms - Host latency: 1.95935 ms (enqueue 0.0859863 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682593 ms - Host latency: 1.95959 ms (enqueue 0.0866211 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.68335 ms - Host latency: 1.95034 ms (enqueue 0.0829346 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.683936 ms - Host latency: 1.94973 ms (enqueue 0.0809814 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682275 ms - Host latency: 1.94255 ms (enqueue 0.0811768 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681348 ms - Host latency: 1.94795 ms (enqueue 0.100903 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.679468 ms - Host latency: 1.95017 ms (enqueue 0.102954 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682129 ms - Host latency: 1.95022 ms (enqueue 0.08479 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680762 ms - Host latency: 1.95127 ms (enqueue 0.0855225 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680176 ms - Host latency: 1.95417 ms (enqueue 0.100732 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.68125 ms - Host latency: 1.94282 ms (enqueue 0.0835205 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.683643 ms - Host latency: 1.94661 ms (enqueue 0.0794678 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.679639 ms - Host latency: 1.94373 ms (enqueue 0.0794678 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682275 ms - Host latency: 1.94321 ms (enqueue 0.0797363 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682373 ms - Host latency: 1.94119 ms (enqueue 0.0793213 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681641 ms - Host latency: 1.94583 ms (enqueue 0.085376 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.684131 ms - Host latency: 1.95923 ms (enqueue 0.086377 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682666 ms - Host latency: 1.95161 ms (enqueue 0.0804688 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681641 ms - Host latency: 1.9553 ms (enqueue 0.080542 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681543 ms - Host latency: 1.94758 ms (enqueue 0.0806396 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680566 ms - Host latency: 1.95237 ms (enqueue 0.0807129 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682983 ms - Host latency: 1.95425 ms (enqueue 0.0999268 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680737 ms - Host latency: 1.95383 ms (enqueue 0.121875 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681104 ms - Host latency: 1.96138 ms (enqueue 0.121118 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.68186 ms - Host latency: 1.95884 ms (enqueue 0.118726 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.683057 ms - Host latency: 1.96328 ms (enqueue 0.121191 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681616 ms - Host latency: 1.94766 ms (enqueue 0.118262 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680542 ms - Host latency: 1.9512 ms (enqueue 0.118872 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682007 ms - Host latency: 1.94917 ms (enqueue 0.119092 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682373 ms - Host latency: 1.95598 ms (enqueue 0.120337 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681982 ms - Host latency: 1.95286 ms (enqueue 0.119092 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.683618 ms - Host latency: 1.95642 ms (enqueue 0.120557 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.68291 ms - Host latency: 1.95552 ms (enqueue 0.116748 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.683496 ms - Host latency: 1.95496 ms (enqueue 0.120312 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681079 ms - Host latency: 1.95454 ms (enqueue 0.118994 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681274 ms - Host latency: 1.94897 ms (enqueue 0.119116 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680859 ms - Host latency: 1.95637 ms (enqueue 0.118262 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.683838 ms - Host latency: 1.95212 ms (enqueue 0.11936 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.683057 ms - Host latency: 1.95725 ms (enqueue 0.119507 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680469 ms - Host latency: 1.95679 ms (enqueue 0.122144 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681274 ms - Host latency: 1.95308 ms (enqueue 0.122656 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.683594 ms - Host latency: 1.96125 ms (enqueue 0.124683 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682935 ms - Host latency: 1.95181 ms (enqueue 0.119971 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680225 ms - Host latency: 1.94724 ms (enqueue 0.11687 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681567 ms - Host latency: 1.94814 ms (enqueue 0.117407 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682813 ms - Host latency: 1.95129 ms (enqueue 0.0829102 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680835 ms - Host latency: 1.94231 ms (enqueue 0.0806396 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681177 ms - Host latency: 1.94717 ms (enqueue 0.0808105 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.68103 ms - Host latency: 1.94348 ms (enqueue 0.0930664 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.683276 ms - Host latency: 1.94697 ms (enqueue 0.0808594 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681909 ms - Host latency: 1.94758 ms (enqueue 0.0816406 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680713 ms - Host latency: 1.9397 ms (enqueue 0.0808105 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682935 ms - Host latency: 1.95659 ms (enqueue 0.0805908 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.68335 ms - Host latency: 1.94539 ms (enqueue 0.0832275 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.683252 ms - Host latency: 1.94578 ms (enqueue 0.0826416 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681543 ms - Host latency: 1.94687 ms (enqueue 0.0811279 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.68147 ms - Host latency: 1.94717 ms (enqueue 0.0822998 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680518 ms - Host latency: 1.95068 ms (enqueue 0.0808594 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.682422 ms - Host latency: 1.9438 ms (enqueue 0.0804688 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.68374 ms - Host latency: 1.94128 ms (enqueue 0.083252 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681738 ms - Host latency: 1.94363 ms (enqueue 0.0834473 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.68042 ms - Host latency: 1.95605 ms (enqueue 0.0884521 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.681787 ms - Host latency: 1.94583 ms (enqueue 0.0844238 ms) [04/18/2023-18:36:48] [I] Average on 10 runs - GPU latency: 0.680859 ms - Host latency: 1.94573 ms (enqueue 0.0811523 ms) [04/18/2023-18:36:48] [I] [04/18/2023-18:36:48] [I] === Performance summary === [04/18/2023-18:36:48] [I] Throughput: 900.019 qps [04/18/2023-18:36:48] [I] Latency: min = 1.86694 ms, max = 2.20752 ms, mean = 1.95191 ms, median = 1.95129 ms, percentile(90%) = 1.9978 ms, percentile(95%) = 2.0094 ms, percentile(99%) = 2.07605 ms [04/18/2023-18:36:48] [I] Enqueue Time: min = 0.0158691 ms, max = 0.154846 ms, mean = 0.0904242 ms, median = 0.0828857 ms, percentile(90%) = 0.114746 ms, percentile(95%) = 0.123535 ms, percentile(99%) = 0.136017 ms [04/18/2023-18:36:48] [I] H2D Latency: min = 0.396606 ms, max = 0.791626 ms, mean = 0.479437 ms, median = 0.522827 ms, percentile(90%) = 0.541992 ms, percentile(95%) = 0.549438 ms, percentile(99%) = 0.628906 ms [04/18/2023-18:36:48] [I] GPU Compute Time: min = 0.669739 ms, max = 0.864258 ms, mean = 0.680808 ms, median = 0.678955 ms, percentile(90%) = 0.68811 ms, percentile(95%) = 0.692139 ms, percentile(99%) = 0.703613 ms [04/18/2023-18:36:48] [I] D2H Latency: min = 0.680786 ms, max = 0.882172 ms, mean = 0.791671 ms, median = 0.803955 ms, percentile(90%) = 0.82251 ms, percentile(95%) = 0.828735 ms, percentile(99%) = 0.838379 ms [04/18/2023-18:36:48] [I] Total Host Walltime: 3.00327 s [04/18/2023-18:36:48] [I] Total GPU Compute Time: 1.84022 s [04/18/2023-18:36:48] [I] Explanations of the performance metrics are printed in the verbose logs. [04/18/2023-18:36:48] [V] [04/18/2023-18:36:48] [V] === Explanations of the performance metrics === [04/18/2023-18:36:48] [V] Total Host Walltime: the host walltime from when the first query (after warmups) is enqueued to when the last query is completed. [04/18/2023-18:36:48] [V] GPU Compute Time: the GPU latency to execute the kernels for a query. [04/18/2023-18:36:48] [V] Total GPU Compute Time: the summation of the GPU Compute Time of all the queries. If this is significantly shorter than Total Host Walltime, the GPU may be under-utilized because of host-side overheads or data transfers. [04/18/2023-18:36:48] [V] Throughput: the observed throughput computed by dividing the number of queries by the Total Host Walltime. If this is significantly lower than the reciprocal of GPU Compute Time, the GPU may be under-utilized because of host-side overheads or data transfers. [04/18/2023-18:36:48] [V] Enqueue Time: the host latency to enqueue a query. If this is longer than GPU Compute Time, the GPU may be under-utilized. [04/18/2023-18:36:48] [V] H2D Latency: the latency for host-to-device data transfers for input tensors of a single query. [04/18/2023-18:36:48] [V] D2H Latency: the latency for device-to-host data transfers for output tensors of a single query. [04/18/2023-18:36:48] [V] Latency: the summation of H2D Latency, GPU Compute Time, and D2H Latency. This is the latency to infer a single query. [04/18/2023-18:36:48] [I] &&&& PASSED TensorRT.trtexec [TensorRT v8503] # trtexec --onnx=ptq-sparse-640.onnx --saveEngine=ptq-tiny-yolov7-sparse-640.trt --int8 --fp16 --sparsity=force --useCudaGraph --verbose